Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29263 originally caused by: Started by upstream project "master-osmo-msc" build number 34207 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bts" build number 7505 originally caused by: Started by upstream project "master-osmo-bts" build number 7566 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5532 originally caused by: Started by upstream project "master-osmo-bts" build number 7566 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8036 originally caused by: Started by upstream project "master-osmo-bts" build number 7566 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17654 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7505 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6679 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8699 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8944 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2949 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29263 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5150 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30040 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4675 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12967 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9239 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4700 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8036 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5189 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5532 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3907 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins1621910492472608094.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-10 00:39:49 + trial_dir_prefix=trial- + rm -rf trial-2366 trial-2366-bin.tgz trial-2366-run.tgz + trial_dir=trial-2367 + mkdir -p trial-2367 + mv open5gs.build-8.tgz osmo-bsc.build-17654.tgz osmo-bts-oc2g.build-5532.tgz osmo-bts-sysmo.build-8036.tgz osmo-bts.build-7505.tgz osmo-ggsn.build-6679.tgz osmo-hlr.build-8699.tgz osmo-hnbgw.build-2949.tgz osmo-mgw.build-8944.tgz osmo-msc.build-29263.tgz osmo-nitb.build-12967.tgz osmo-pcu-oc2g.build-3907.tgz osmo-pcu-sysmo.build-5189.tgz osmo-pcu.build-5150.tgz osmo-sgsn.build-30040.tgz osmo-stp.build-9239.tgz osmo-trx.build-4675.tgz osmocom-bb.build-4700.tgz srslte.build-19.tgz trial-2367 + cat open5gs.build-8.md5 osmo-bsc.build-17654.md5 osmo-bts-oc2g.build-5532.md5 osmo-bts-sysmo.build-8036.md5 osmo-bts.build-7505.md5 osmo-ggsn.build-6679.md5 osmo-hlr.build-8699.md5 osmo-hnbgw.build-2949.md5 osmo-mgw.build-8944.md5 osmo-msc.build-29263.md5 osmo-nitb.build-12967.md5 osmo-pcu-oc2g.build-3907.md5 osmo-pcu-sysmo.build-5189.md5 osmo-pcu.build-5150.md5 osmo-sgsn.build-30040.md5 osmo-stp.build-9239.md5 osmo-trx.build-4675.md5 osmocom-bb.build-4700.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17654.md5 osmo-bts-oc2g.build-5532.md5 osmo-bts-sysmo.build-8036.md5 osmo-bts.build-7505.md5 osmo-ggsn.build-6679.md5 osmo-hlr.build-8699.md5 osmo-hnbgw.build-2949.md5 osmo-mgw.build-8944.md5 osmo-msc.build-29263.md5 osmo-nitb.build-12967.md5 osmo-pcu-oc2g.build-3907.md5 osmo-pcu-sysmo.build-5189.md5 osmo-pcu.build-5150.md5 osmo-sgsn.build-30040.md5 osmo-stp.build-9239.md5 osmo-trx.build-4675.md5 osmocom-bb.build-4700.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2367 combinations: None trial: 'trial-2367' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2367 -------------------------------------------------------------------------------------------- 00:40:00.453815 tst trial-2367: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/log --------------------------------------------------------------------- trial-2367 nitb_sms:sysmo --------------------------------------------------------------------- 00:42:09.434973 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:42:09.439421 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 00:42:09.462385 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 00:42:09.470257 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 00:42:09.525288 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 00:42:09.546795 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 00:42:09.553838 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 00:42:10.093158 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 00:42:10.098331 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 00:42:10.109533 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 00:42:10.497360 tst mo_mt_sms.py: using LAC 24791 00:42:10.746867 tst mo_mt_sms.py: using RAC 56 00:42:10.870875 tst mo_mt_sms.py: using CellId 24791 00:42:10.993292 tst mo_mt_sms.py: using BVCI 24792 00:42:11.107662 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 00:42:11.288195 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 00:42:11.406405 tst mo_mt_sms.py:9: start nitb and bts... 00:42:11.623018 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:42:13.985700 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3671): Launched 00:42:14.288460 run osmo-nitb_10.42.42.2(pid=3672): Launched 00:42:14.453399 run osmo-nitb_10.42.42.2(pid=3672): ERR: Terminated: ERROR {rc=2} [trial-2367↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3672)] 00:42:14.577928 run osmo-nitb_10.42.42.2(pid=3672): stdout: | (launched: 2022-12-10_00:42:14.231820) 00:42:14.703174 run osmo-nitb_10.42.42.2(pid=3672): stderr: | (launched: 2022-12-10_00:42:14.276703) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:42:14.828285 run osmo-nitb_10.42.42.2(pid=3672): stdout: | (launched: 2022-12-10_00:42:14.231820) 00:42:14.948362 run osmo-nitb_10.42.42.2(pid=3672): stderr: | (launched: 2022-12-10_00:42:14.276703) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:42:15.090964 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=3672): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3672) [trial-2367↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3672)] [trial-2367↪nitb_sms:sysmo↪mo_mt_sms.py:11] 00:42:15.099078 tst mo_mt_sms.py:11: Test FAILED (5.0 sec) 00:42:15.105598 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3671): Terminating (SIGTERM) 00:42:15.314418 --- ParallelTerminationStrategy: PID 3671 died... 00:42:15.335359 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3671): Terminated: ok {rc=0} 00:42:15.422406 bus /sierra_3: Setting Powered False 00:42:16.531057 bus /sierra_3: Setting Powered False 00:42:17.662039 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 sms:sysmo --------------------------------------------------------------------- 00:42:18.847687 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:42:18.852184 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 00:42:18.874766 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 00:42:18.902096 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 00:42:18.956276 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 00:42:18.978312 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 00:42:19.005731 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 00:42:19.553296 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 sms:sysmo mo_mt_sms.py ---------------------------------------------- 00:42:19.558660 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 00:42:19.569735 tst sms:sysmo: Using 1 x bts (candidates: 1) 00:42:19.604420 tst mo_mt_sms.py: using LAC 24792 00:42:19.733974 tst mo_mt_sms.py: using RAC 57 00:42:19.858397 tst mo_mt_sms.py: using CellId 24792 00:42:19.982322 tst mo_mt_sms.py: using BVCI 24793 00:42:20.100300 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 00:42:20.111327 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 00:42:20.122247 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 00:42:20.133355 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 00:42:20.144417 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 00:42:20.155599 tst sms:sysmo: Using 1 x modem (candidates: 2) 00:42:20.271603 tst sms:sysmo: Using 1 x modem (candidates: 2) 00:42:20.393038 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:42:22.156395 run create_hlr_db(pid=3676): Launched 00:42:22.290075 bus /sierra_2: Setting Powered False 00:42:23.353490 run create_hlr_db(pid=3676): Terminated: ok {rc=0} 00:42:23.788586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3678): Launched 00:42:24.093220 run osmo-hlr_10.42.42.2(pid=3679): Launched 00:42:24.209138 run osmo-stp_10.42.42.5: Starting osmo-stp 00:42:26.682822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3681): Launched 00:42:26.987609 run osmo-stp_10.42.42.5(pid=3682): Launched 00:42:27.104635 run osmo-msc_10.42.42.6: Starting osmo-msc 00:42:32.539606 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3684): Launched 00:42:32.864638 run osmo-msc_10.42.42.6(pid=3685): Launched 00:42:33.046163 run osmo-stp_10.42.42.5(pid=3682): ERR: Terminated: ERROR {rc=1} [trial-2367↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3682)] 00:42:33.182374 run osmo-stp_10.42.42.5(pid=3682): stdout: | (launched: 2022-12-10_00:42:26.930277) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:42:33.318177 run osmo-stp_10.42.42.5(pid=3682): stderr: | 20221210004227104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004227104 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004227105 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004227105 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004227105 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004227106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004227106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:42:33.453700 run osmo-stp_10.42.42.5(pid=3682): stdout: | (launched: 2022-12-10_00:42:26.930277) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:42:33.582292 run osmo-stp_10.42.42.5(pid=3682): stderr: | 20221210004227104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004227104 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004227105 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004227105 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004227105 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004227106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004227106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:42:33.735638 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=3682): Process ended prematurely: osmo-stp_10.42.42.5(pid=3682) [trial-2367↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3682)] [trial-2367↪sms:sysmo↪mo_mt_sms.py:16] 00:42:33.744543 tst mo_mt_sms.py:16: Test FAILED (14.2 sec) 00:42:33.771961 run osmo-hlr_10.42.42.2(pid=3679): ERR: Terminated: ERROR {rc=237} [trial-2367↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3679)] 00:42:33.822525 run osmo-hlr_10.42.42.2(pid=3679): stdout: | (launched: 2022-12-10_00:42:24.036009) 00:42:33.875259 run osmo-hlr_10.42.42.2(pid=3679): stderr: | 20221210004224213 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004224213 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004224213 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004224214 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004224214 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004224214 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004224226 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004224235 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004224235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004224235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:42:33.948037 run osmo-msc_10.42.42.6(pid=3685): ERR: Terminated: ERROR {rc=2} [trial-2367↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3685)] 00:42:33.998690 run osmo-msc_10.42.42.6(pid=3685): stdout: | (launched: 2022-12-10_00:42:32.803963) 00:42:34.051323 run osmo-msc_10.42.42.6(pid=3685): stderr: | 20221210004233133 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210004233133 DLGLOBAL DEBUG validating counter group 0x7f7d05984c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210004233134 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210004233134 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210004233134 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210004233134 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210004233136 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210004233136 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210004233136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210004233136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:42:34.104001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3678): Terminating (SIGTERM) 00:42:34.146469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3681): Terminating (SIGTERM) 00:42:34.188466 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3684): Terminating (SIGTERM) 00:42:34.231293 --- ParallelTerminationStrategy: PID 3678 died... 00:42:34.251453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3678): Terminated: ok {rc=0} 00:42:34.298148 --- ParallelTerminationStrategy: PID 3681 died... 00:42:34.317950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3681): Terminated: ok {rc=0} 00:42:34.364466 --- ParallelTerminationStrategy: PID 3684 died... 00:42:34.384332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3684): Terminated: ok {rc=0} 00:42:34.473268 bus /sierra_3: Setting Powered False 00:42:35.574310 bus /sierra_3: Setting Powered False 00:42:36.693387 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 nitb_ussd:sysmo --------------------------------------------------------------------- 00:42:37.911065 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:42:37.915017 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 00:42:37.936304 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 00:42:37.943368 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 00:42:37.981899 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 00:42:38.004005 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 00:42:38.010985 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 00:42:38.527319 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2367 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 00:42:38.533654 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 00:42:38.545725 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 00:42:38.580588 tst assert_extension.py: using LAC 24793 00:42:38.709060 tst assert_extension.py: using RAC 58 00:42:38.835710 tst assert_extension.py: using CellId 24793 00:42:38.962476 tst assert_extension.py: using BVCI 24794 00:42:39.081673 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 00:42:39.201400 tst assert_extension.py:10: start nitb and bts... 00:42:39.418435 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:42:40.079720 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3690): Launched 00:42:40.405467 run osmo-nitb_10.42.42.2(pid=3691): Launched 00:42:40.586339 run osmo-nitb_10.42.42.2(pid=3691): ERR: Terminated: ERROR {rc=2} [trial-2367↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3691)] 00:42:40.730570 run osmo-nitb_10.42.42.2(pid=3691): stdout: | (launched: 2022-12-10_00:42:40.344606) 00:42:40.876584 run osmo-nitb_10.42.42.2(pid=3691): stderr: | (launched: 2022-12-10_00:42:40.392689) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:42:41.022315 run osmo-nitb_10.42.42.2(pid=3691): stdout: | (launched: 2022-12-10_00:42:40.344606) 00:42:41.166192 run osmo-nitb_10.42.42.2(pid=3691): stderr: | (launched: 2022-12-10_00:42:40.392689) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=3691): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3691) [trial-2367↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3691)] 00:42:41.529471 tst osmo-nitb_10.42.42.2(pid=3691): stdout: | (launched: 2022-12-10_00:42:40.344606) 00:42:41.659822 tst osmo-nitb_10.42.42.2(pid=3691): stderr: | (launched: 2022-12-10_00:42:40.392689) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:42:41.813970 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=3691): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3691) [trial-2367↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3691)] [trial-2367↪nitb_ussd:sysmo↪assert_extension.py:12] 00:42:41.822785 tst assert_extension.py:12: Test FAILED (3.3 sec) 00:42:41.829974 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3690): Terminating (SIGTERM) 00:42:42.040584 --- ParallelTerminationStrategy: PID 3690 died... 00:42:42.061939 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3690): Terminated: ok {rc=0} 00:42:42.150385 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 ussd:sysmo --------------------------------------------------------------------- 00:42:43.311024 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:42:43.314913 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 00:42:43.335744 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 00:42:43.362707 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 00:42:43.398846 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 00:42:43.420477 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 00:42:43.448060 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 00:42:43.972108 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2367 ussd:sysmo assert_extension.py ---------------------------------------------- 00:42:43.977867 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 00:42:43.988492 tst ussd:sysmo: Using 1 x bts (candidates: 1) 00:42:44.023186 tst assert_extension.py: using LAC 24794 00:42:44.143042 tst assert_extension.py: using RAC 59 00:42:44.260893 tst assert_extension.py: using CellId 24794 00:42:44.379681 tst assert_extension.py: using BVCI 24795 00:42:44.498925 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 00:42:44.509900 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 00:42:44.521531 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 00:42:44.532435 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 00:42:44.543277 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 00:42:44.554033 tst ussd:sysmo: Using 1 x modem (candidates: 1) 00:42:44.666751 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:42:45.136595 run create_hlr_db(pid=3695): Launched 00:42:45.253508 bus /sierra_2: Setting Powered False 00:42:46.353533 run create_hlr_db(pid=3695): Terminated: ok {rc=0} 00:42:46.786551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3697): Launched 00:42:47.108074 run osmo-hlr_10.42.42.2(pid=3698): Launched 00:42:47.231435 run osmo-stp_10.42.42.5: Starting osmo-stp 00:42:47.769800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3700): Launched 00:42:48.074361 run osmo-stp_10.42.42.5(pid=3701): Launched 00:42:48.192025 run osmo-msc_10.42.42.6: Starting osmo-msc 00:42:48.738718 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3703): Launched 00:42:49.042963 run osmo-msc_10.42.42.6(pid=3704): Launched 00:42:49.215697 run osmo-stp_10.42.42.5(pid=3701): ERR: Terminated: ERROR {rc=1} [trial-2367↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3701)] 00:42:49.345280 run osmo-stp_10.42.42.5(pid=3701): stdout: | (launched: 2022-12-10_00:42:48.016645) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:42:49.474260 run osmo-stp_10.42.42.5(pid=3701): stderr: | 20221210004248188 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004248188 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004248189 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004248189 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004248189 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004248189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004248190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:42:49.601229 run osmo-stp_10.42.42.5(pid=3701): stdout: | (launched: 2022-12-10_00:42:48.016645) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:42:49.721613 run osmo-stp_10.42.42.5(pid=3701): stderr: | 20221210004248188 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004248188 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004248189 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004248189 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004248189 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004248189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004248190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:42:49.865673 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=3701): Process ended prematurely: osmo-stp_10.42.42.5(pid=3701) [trial-2367↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3701)] [trial-2367↪ussd:sysmo↪assert_extension.py:17] 00:42:49.873907 tst assert_extension.py:17: Test FAILED (5.9 sec) 00:42:49.900195 run osmo-hlr_10.42.42.2(pid=3698): ERR: Terminated: ERROR {rc=237} [trial-2367↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3698)] 00:42:49.948780 run osmo-hlr_10.42.42.2(pid=3698): stdout: | (launched: 2022-12-10_00:42:47.050528) 00:42:49.999145 run osmo-hlr_10.42.42.2(pid=3698): stderr: | 20221210004247298 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004247298 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004247298 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004247299 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004247299 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004247299 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004247316 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004247325 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004247325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004247325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:42:50.069073 run osmo-msc_10.42.42.6(pid=3704): ERR: Terminated: ERROR {rc=2} [trial-2367↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3704)] 00:42:50.117738 run osmo-msc_10.42.42.6(pid=3704): stdout: | (launched: 2022-12-10_00:42:48.985408) 00:42:50.168076 run osmo-msc_10.42.42.6(pid=3704): stderr: | 20221210004249260 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210004249260 DLGLOBAL DEBUG validating counter group 0x7f16d3a6bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210004249260 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210004249260 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210004249260 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210004249260 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210004249262 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210004249262 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210004249263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210004249263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:42:50.218839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3697): Terminating (SIGTERM) 00:42:50.259348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3700): Terminating (SIGTERM) 00:42:50.299663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3703): Terminating (SIGTERM) 00:42:50.340094 --- ParallelTerminationStrategy: PID 3697 died... 00:42:50.359416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3697): Terminated: ok {rc=0} 00:42:50.404019 --- ParallelTerminationStrategy: PID 3700 died... 00:42:50.422682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3700): Terminated: ok {rc=0} 00:42:50.467175 --- ParallelTerminationStrategy: PID 3703 died... 00:42:50.485786 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3703): Terminated: ok {rc=0} 00:42:50.572243 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 00:42:51.772360 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:42:51.779377 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 00:42:51.801794 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 00:42:51.829613 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 00:42:51.883470 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 00:42:51.904835 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 00:42:51.933196 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 00:42:52.485107 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 00:42:52.540565 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:42:52.552063 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:42:52.611036 tst mo_mt_call.py: using LAC 24795 00:42:52.747506 tst mo_mt_call.py: using RAC 60 00:42:52.876327 tst mo_mt_call.py: using CellId 24795 00:42:53.004328 tst mo_mt_call.py: using BVCI 24796 00:42:53.125501 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:42:53.137117 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:42:53.148448 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:42:53.160433 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:42:53.172333 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:42:53.184253 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:42:53.303007 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:42:53.421288 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:42:53.935401 run create_hlr_db(pid=3709): Launched 00:42:54.068313 bus /sierra_2: Setting Powered False 00:42:55.133507 run create_hlr_db(pid=3709): Terminated: ok {rc=0} 00:42:55.574777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3711): Launched 00:42:55.886379 run osmo-hlr_10.42.42.2(pid=3712): Launched 00:42:56.005900 run osmo-stp_10.42.42.5: Starting osmo-stp 00:42:56.554101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3714): Launched 00:42:56.866867 run osmo-stp_10.42.42.5(pid=3715): Launched 00:42:56.986360 run osmo-msc_10.42.42.6: Starting osmo-msc 00:42:57.548929 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3717): Launched 00:42:57.864746 run osmo-msc_10.42.42.6(pid=3718): Launched 00:42:58.052107 run osmo-stp_10.42.42.5(pid=3715): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3715)] 00:42:58.192102 run osmo-stp_10.42.42.5(pid=3715): stdout: | (launched: 2022-12-10_00:42:56.808523) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:42:58.332201 run osmo-stp_10.42.42.5(pid=3715): stderr: | 20221210004256984 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004256985 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004256985 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004256985 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004256986 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004256986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004256986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:42:58.469751 run osmo-stp_10.42.42.5(pid=3715): stdout: | (launched: 2022-12-10_00:42:56.808523) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:42:58.601464 run osmo-stp_10.42.42.5(pid=3715): stderr: | 20221210004256984 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004256985 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004256985 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004256985 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004256986 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004256986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004256986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:42:58.758653 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3715): Process ended prematurely: osmo-stp_10.42.42.5(pid=3715) [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3715)] [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 00:42:58.768020 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 00:42:58.795952 run osmo-hlr_10.42.42.2(pid=3712): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3712)] 00:42:58.846709 run osmo-hlr_10.42.42.2(pid=3712): stdout: | (launched: 2022-12-10_00:42:55.828106) 00:42:58.899307 run osmo-hlr_10.42.42.2(pid=3712): stderr: | 20221210004256008 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004256008 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004256008 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004256008 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004256008 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004256008 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004256023 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004256033 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004256033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004256033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:42:58.972460 run osmo-msc_10.42.42.6(pid=3718): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3718)] 00:42:59.023200 run osmo-msc_10.42.42.6(pid=3718): stdout: | (launched: 2022-12-10_00:42:57.803236) 00:42:59.075684 run osmo-msc_10.42.42.6(pid=3718): stderr: | 20221210004258126 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210004258126 DLGLOBAL DEBUG validating counter group 0x7f39728e6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210004258127 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210004258127 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210004258127 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210004258127 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210004258129 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210004258129 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210004258129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210004258129 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:42:59.128590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3711): Terminating (SIGTERM) 00:42:59.171037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3714): Terminating (SIGTERM) 00:42:59.213588 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3717): Terminating (SIGTERM) 00:42:59.256535 --- ParallelTerminationStrategy: PID 3711 died... 00:42:59.276912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3711): Terminated: ok {rc=0} 00:42:59.323901 --- ParallelTerminationStrategy: PID 3714 died... 00:42:59.343825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3714): Terminated: ok {rc=0} 00:42:59.390478 --- ParallelTerminationStrategy: PID 3717 died... 00:42:59.410190 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3717): Terminated: ok {rc=0} 00:42:59.498396 bus /sierra_3: Setting Powered False 00:43:00.596134 bus /sierra_3: Setting Powered False 00:43:01.716781 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 00:43:02.879909 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:43:02.891868 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:43:02.952118 tst mo_mt_call_osmux.py: using LAC 24796 00:43:03.072350 tst mo_mt_call_osmux.py: using RAC 61 00:43:03.190681 tst mo_mt_call_osmux.py: using CellId 24796 00:43:03.310901 tst mo_mt_call_osmux.py: using BVCI 24797 00:43:03.422764 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:43:03.433890 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:43:03.444786 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:43:03.455896 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:43:03.467101 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:43:03.478601 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:43:03.594334 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:43:03.714365 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:43:04.229435 run create_hlr_db(pid=3720): Launched 00:43:04.366400 bus /sierra_2: Setting Powered False 00:43:05.431538 run create_hlr_db(pid=3720): Terminated: ok {rc=0} 00:43:05.892713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3722): Launched 00:43:06.225889 run osmo-hlr_10.42.42.2(pid=3723): Launched 00:43:06.353986 run osmo-stp_10.42.42.5: Starting osmo-stp 00:43:06.926081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3725): Launched 00:43:07.258205 run osmo-stp_10.42.42.5(pid=3726): Launched 00:43:07.384319 run osmo-msc_10.42.42.6: Starting osmo-msc 00:43:07.986057 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3728): Launched 00:43:08.318852 run osmo-msc_10.42.42.6(pid=3729): Launched 00:43:08.502069 run osmo-stp_10.42.42.5(pid=3726): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3726)] 00:43:08.641522 run osmo-stp_10.42.42.5(pid=3726): stdout: | (launched: 2022-12-10_00:43:07.196346) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:43:08.780292 run osmo-stp_10.42.42.5(pid=3726): stderr: | 20221210004307393 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004307393 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004307393 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004307394 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004307396 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004307396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004307396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:43:08.918035 run osmo-stp_10.42.42.5(pid=3726): stdout: | (launched: 2022-12-10_00:43:07.196346) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:43:09.049368 run osmo-stp_10.42.42.5(pid=3726): stderr: | 20221210004307393 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004307393 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004307393 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004307394 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004307396 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004307396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004307396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:43:09.206576 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3726): Process ended prematurely: osmo-stp_10.42.42.5(pid=3726) [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3726)] [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 00:43:09.216041 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 00:43:09.244103 run osmo-hlr_10.42.42.2(pid=3723): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3723)] 00:43:09.294899 run osmo-hlr_10.42.42.2(pid=3723): stdout: | (launched: 2022-12-10_00:43:06.164033) 00:43:09.348004 run osmo-hlr_10.42.42.2(pid=3723): stderr: | 20221210004306368 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004306368 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004306368 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004306368 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004306368 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004306368 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004306420 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004306429 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004306429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004306429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:43:09.421346 run osmo-msc_10.42.42.6(pid=3729): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3729)] 00:43:09.472319 run osmo-msc_10.42.42.6(pid=3729): stdout: | (launched: 2022-12-10_00:43:08.257361) 00:43:09.525257 run osmo-msc_10.42.42.6(pid=3729): stderr: | 20221210004308586 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210004308586 DLGLOBAL DEBUG validating counter group 0x7f239ff3bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210004308587 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210004308587 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210004308587 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210004308587 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210004308589 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210004308589 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210004308589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210004308589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:43:09.578405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3722): Terminating (SIGTERM) 00:43:09.620626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3725): Terminating (SIGTERM) 00:43:09.662796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3728): Terminating (SIGTERM) 00:43:09.705163 --- ParallelTerminationStrategy: PID 3722 died... 00:43:09.725322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3722): Terminated: ok {rc=0} 00:43:09.772281 --- ParallelTerminationStrategy: PID 3725 died... 00:43:09.792038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3725): Terminated: ok {rc=0} 00:43:09.838739 --- ParallelTerminationStrategy: PID 3728 died... 00:43:09.858516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3728): Terminated: ok {rc=0} 00:43:09.947101 bus /sierra_3: Setting Powered False 00:43:11.048124 bus /sierra_3: Setting Powered False 00:43:12.165843 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 00:43:13.403707 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:43:13.410648 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 00:43:13.432462 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 00:43:13.459643 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 00:43:13.511558 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 00:43:13.532921 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 00:43:13.560889 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 00:43:14.117345 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 00:43:14.169553 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:14.180935 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:43:14.237502 tst mo_mt_call.py: using LAC 24797 00:43:14.364738 tst mo_mt_call.py: using RAC 62 00:43:14.493353 tst mo_mt_call.py: using CellId 24797 00:43:14.618426 tst mo_mt_call.py: using BVCI 24798 00:43:14.731783 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:14.743109 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:14.754287 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:14.766269 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:14.778200 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:14.790077 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:43:14.911948 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:43:15.032397 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:43:15.548105 run create_hlr_db(pid=3734): Launched 00:43:15.674709 bus /sierra_2: Setting Powered False 00:43:16.752416 run create_hlr_db(pid=3734): Terminated: ok {rc=0} 00:43:17.232139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3736): Launched 00:43:17.575112 run osmo-hlr_10.42.42.2(pid=3737): Launched 00:43:17.710224 run osmo-stp_10.42.42.5: Starting osmo-stp 00:43:18.279927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3739): Launched 00:43:18.611792 run osmo-stp_10.42.42.5(pid=3740): Launched 00:43:18.738294 run osmo-msc_10.42.42.6: Starting osmo-msc 00:43:19.334769 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3742): Launched 00:43:19.667804 run osmo-msc_10.42.42.6(pid=3743): Launched 00:43:19.854495 run osmo-stp_10.42.42.5(pid=3740): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3740)] 00:43:19.994257 run osmo-stp_10.42.42.5(pid=3740): stdout: | (launched: 2022-12-10_00:43:18.550212) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:43:20.133816 run osmo-stp_10.42.42.5(pid=3740): stderr: | 20221210004318745 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004318746 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004318746 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004318747 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004318747 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004318747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004318747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:43:20.271036 run osmo-stp_10.42.42.5(pid=3740): stdout: | (launched: 2022-12-10_00:43:18.550212) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:43:20.402748 run osmo-stp_10.42.42.5(pid=3740): stderr: | 20221210004318745 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004318746 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004318746 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004318747 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004318747 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004318747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004318747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:43:20.560025 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3740): Process ended prematurely: osmo-stp_10.42.42.5(pid=3740) [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3740)] [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 00:43:20.569534 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 00:43:20.597295 run osmo-hlr_10.42.42.2(pid=3737): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3737)] 00:43:20.647657 run osmo-hlr_10.42.42.2(pid=3737): stdout: | (launched: 2022-12-10_00:43:17.513031) 00:43:20.699752 run osmo-hlr_10.42.42.2(pid=3737): stderr: | 20221210004317715 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004317715 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004317715 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004317715 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004317715 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004317715 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004317726 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004317736 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004317736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004317736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:43:20.772187 run osmo-msc_10.42.42.6(pid=3743): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3743)] 00:43:20.822488 run osmo-msc_10.42.42.6(pid=3743): stdout: | (launched: 2022-12-10_00:43:19.606139) 00:43:20.874466 run osmo-msc_10.42.42.6(pid=3743): stderr: | 20221210004319929 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210004319929 DLGLOBAL DEBUG validating counter group 0x7fcd2501bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210004319930 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210004319930 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210004319930 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210004319931 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210004319933 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210004319933 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210004319933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210004319933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:43:20.926834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3736): Terminating (SIGTERM) 00:43:20.968843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3739): Terminating (SIGTERM) 00:43:21.010935 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3742): Terminating (SIGTERM) 00:43:21.053163 --- ParallelTerminationStrategy: PID 3736 died... 00:43:21.073202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3736): Terminated: ok {rc=0} 00:43:21.119480 --- ParallelTerminationStrategy: PID 3739 died... 00:43:21.138951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3739): Terminated: ok {rc=0} 00:43:21.185272 --- ParallelTerminationStrategy: PID 3742 died... 00:43:21.204862 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3742): Terminated: ok {rc=0} 00:43:21.292611 bus /sierra_3: Setting Powered False 00:43:22.392044 bus /sierra_3: Setting Powered False 00:43:23.507929 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 00:43:24.658661 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:24.670911 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:43:24.729057 tst mo_mt_call_osmux.py: using LAC 24798 00:43:24.861129 tst mo_mt_call_osmux.py: using RAC 63 00:43:24.992447 tst mo_mt_call_osmux.py: using CellId 24798 00:43:25.122074 tst mo_mt_call_osmux.py: using BVCI 24799 00:43:25.243204 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:25.254799 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:25.266278 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:25.277647 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:25.288883 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:25.300269 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:43:25.418622 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:43:25.541094 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:43:26.054049 run create_hlr_db(pid=3745): Launched 00:43:26.189284 bus /sierra_2: Setting Powered False 00:43:27.254544 run create_hlr_db(pid=3745): Terminated: ok {rc=0} 00:43:27.697304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3747): Launched 00:43:28.009272 run osmo-hlr_10.42.42.2(pid=3748): Launched 00:43:28.128504 run osmo-stp_10.42.42.5: Starting osmo-stp 00:43:28.661281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3750): Launched 00:43:28.972444 run osmo-stp_10.42.42.5(pid=3751): Launched 00:43:29.090791 run osmo-msc_10.42.42.6: Starting osmo-msc 00:43:29.651212 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3753): Launched 00:43:29.963071 run osmo-msc_10.42.42.6(pid=3754): Launched 00:43:30.137121 run osmo-stp_10.42.42.5(pid=3751): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3751)] 00:43:30.268092 run osmo-stp_10.42.42.5(pid=3751): stdout: | (launched: 2022-12-10_00:43:28.914453) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:43:30.398117 run osmo-stp_10.42.42.5(pid=3751): stderr: | 20221210004329085 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004329085 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004329085 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004329086 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004329088 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004329088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004329088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:43:30.526395 run osmo-stp_10.42.42.5(pid=3751): stdout: | (launched: 2022-12-10_00:43:28.914453) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:43:30.648859 run osmo-stp_10.42.42.5(pid=3751): stderr: | 20221210004329085 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004329085 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004329085 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004329086 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004329088 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004329088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004329088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:43:30.795954 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3751): Process ended prematurely: osmo-stp_10.42.42.5(pid=3751) [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3751)] [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 00:43:30.804662 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 00:43:30.841133 run osmo-hlr_10.42.42.2(pid=3748): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3748)] 00:43:30.913267 run osmo-hlr_10.42.42.2(pid=3748): stdout: | (launched: 2022-12-10_00:43:27.950968) 00:43:30.967982 run osmo-hlr_10.42.42.2(pid=3748): stderr: | 20221210004328127 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004328127 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004328127 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004328127 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004328127 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004328127 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004328140 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004328148 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004328148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004328148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:43:31.042747 run osmo-msc_10.42.42.6(pid=3754): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3754)] 00:43:31.094410 run osmo-msc_10.42.42.6(pid=3754): stdout: | (launched: 2022-12-10_00:43:29.904581) 00:43:31.148844 run osmo-msc_10.42.42.6(pid=3754): stderr: | 20221210004330181 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210004330181 DLGLOBAL DEBUG validating counter group 0x7f432b872c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210004330181 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210004330181 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210004330181 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210004330181 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210004330183 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210004330183 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210004330184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210004330184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:43:31.203682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3747): Terminating (SIGTERM) 00:43:31.247485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3750): Terminating (SIGTERM) 00:43:31.293217 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3753): Terminating (SIGTERM) 00:43:31.340178 --- ParallelTerminationStrategy: PID 3747 died... 00:43:31.361103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3747): Terminated: ok {rc=0} 00:43:31.409941 --- ParallelTerminationStrategy: PID 3750 died... 00:43:31.430470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3750): Terminated: ok {rc=0} 00:43:31.477719 --- ParallelTerminationStrategy: PID 3753 died... 00:43:31.498734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3753): Terminated: ok {rc=0} 00:43:31.590511 bus /sierra_3: Setting Powered False 00:43:32.700277 bus /sierra_3: Setting Powered False 00:43:33.816146 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 00:43:35.051213 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:43:35.057516 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 00:43:35.078921 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 00:43:35.105562 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 00:43:35.157675 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 00:43:35.178812 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 00:43:35.205403 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 00:43:35.754417 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 00:43:35.804438 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:43:35.815489 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:43:35.871001 tst mo_mt_call.py: using LAC 24799 00:43:35.992810 tst mo_mt_call.py: using RAC 64 00:43:36.113051 tst mo_mt_call.py: using CellId 24799 00:43:36.233100 tst mo_mt_call.py: using BVCI 24800 00:43:36.344778 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:43:36.355947 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:43:36.366738 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:43:36.377844 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:43:36.388836 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:43:36.399940 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:43:36.520912 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:43:36.644698 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:43:37.159294 run create_hlr_db(pid=3759): Launched 00:43:37.295993 bus /sierra_2: Setting Powered False 00:43:38.361353 run create_hlr_db(pid=3759): Terminated: ok {rc=0} 00:43:38.803528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3761): Launched 00:43:39.115138 run osmo-hlr_10.42.42.2(pid=3762): Launched 00:43:39.234570 run osmo-stp_10.42.42.5: Starting osmo-stp 00:43:39.788400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3764): Launched 00:43:40.101148 run osmo-stp_10.42.42.5(pid=3765): Launched 00:43:40.218875 run osmo-msc_10.42.42.6: Starting osmo-msc 00:43:40.777294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3767): Launched 00:43:41.089186 run osmo-msc_10.42.42.6(pid=3768): Launched 00:43:41.263820 run osmo-stp_10.42.42.5(pid=3765): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3765)] 00:43:41.394994 run osmo-stp_10.42.42.5(pid=3765): stdout: | (launched: 2022-12-10_00:43:40.042959) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:43:41.525933 run osmo-stp_10.42.42.5(pid=3765): stderr: | 20221210004340218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004340218 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004340218 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004340219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004340219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004340219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004340219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:43:41.655306 run osmo-stp_10.42.42.5(pid=3765): stdout: | (launched: 2022-12-10_00:43:40.042959) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:43:41.778638 run osmo-stp_10.42.42.5(pid=3765): stderr: | 20221210004340218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004340218 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004340218 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004340219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004340219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004340219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004340219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:43:41.926278 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3765): Process ended prematurely: osmo-stp_10.42.42.5(pid=3765) [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3765)] [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 00:43:41.935390 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 00:43:41.962442 run osmo-hlr_10.42.42.2(pid=3762): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3762)] 00:43:42.011352 run osmo-hlr_10.42.42.2(pid=3762): stdout: | (launched: 2022-12-10_00:43:39.056856) 00:43:42.061545 run osmo-hlr_10.42.42.2(pid=3762): stderr: | 20221210004339234 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004339234 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004339234 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004339234 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004339234 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004339235 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004339251 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004339262 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004339262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004339262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:43:42.131186 run osmo-msc_10.42.42.6(pid=3768): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3768)] 00:43:42.179526 run osmo-msc_10.42.42.6(pid=3768): stdout: | (launched: 2022-12-10_00:43:41.030578) 00:43:42.229556 run osmo-msc_10.42.42.6(pid=3768): stderr: | 20221210004341306 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210004341306 DLGLOBAL DEBUG validating counter group 0x7f0441a4ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210004341306 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210004341306 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210004341306 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210004341306 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210004341308 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210004341308 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210004341308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210004341309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:43:42.279796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3761): Terminating (SIGTERM) 00:43:42.320128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3764): Terminating (SIGTERM) 00:43:42.360474 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3767): Terminating (SIGTERM) 00:43:42.401086 --- ParallelTerminationStrategy: PID 3761 died... 00:43:42.420263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3761): Terminated: ok {rc=0} 00:43:42.465130 --- ParallelTerminationStrategy: PID 3764 died... 00:43:42.483879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3764): Terminated: ok {rc=0} 00:43:42.528551 --- ParallelTerminationStrategy: PID 3767 died... 00:43:42.547448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3767): Terminated: ok {rc=0} 00:43:42.631937 bus /sierra_3: Setting Powered False 00:43:43.731107 bus /sierra_3: Setting Powered False 00:43:44.848030 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 00:43:46.007055 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:43:46.019880 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:43:46.079874 tst mo_mt_call_osmux.py: using LAC 24800 00:43:46.204786 tst mo_mt_call_osmux.py: using RAC 65 00:43:46.340313 tst mo_mt_call_osmux.py: using CellId 24800 00:43:46.473624 tst mo_mt_call_osmux.py: using BVCI 24801 00:43:46.590387 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:43:46.602604 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:43:46.614578 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:43:46.627175 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:43:46.640100 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:43:46.653937 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:43:46.774290 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:43:46.923406 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:43:47.453959 run create_hlr_db(pid=3770): Launched 00:43:47.575573 bus /sierra_2: Setting Powered False 00:43:48.636510 run create_hlr_db(pid=3770): Terminated: ok {rc=0} 00:43:49.068003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3772): Launched 00:43:49.379744 run osmo-hlr_10.42.42.2(pid=3773): Launched 00:43:49.499586 run osmo-stp_10.42.42.5: Starting osmo-stp 00:43:50.031056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3775): Launched 00:43:50.344469 run osmo-stp_10.42.42.5(pid=3776): Launched 00:43:50.463943 run osmo-msc_10.42.42.6: Starting osmo-msc 00:43:51.024372 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3778): Launched 00:43:51.337320 run osmo-msc_10.42.42.6(pid=3779): Launched 00:43:51.511849 run osmo-stp_10.42.42.5(pid=3776): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3776)] 00:43:51.644777 run osmo-stp_10.42.42.5(pid=3776): stdout: | (launched: 2022-12-10_00:43:50.286031) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:43:51.776425 run osmo-stp_10.42.42.5(pid=3776): stderr: | 20221210004350458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004350459 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004350459 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004350459 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004350460 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004350460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004350460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:43:51.905786 run osmo-stp_10.42.42.5(pid=3776): stdout: | (launched: 2022-12-10_00:43:50.286031) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:43:52.029678 run osmo-stp_10.42.42.5(pid=3776): stderr: | 20221210004350458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004350459 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004350459 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004350459 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004350460 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004350460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004350460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:43:52.177533 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3776): Process ended prematurely: osmo-stp_10.42.42.5(pid=3776) [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3776)] [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 00:43:52.186492 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 00:43:52.213618 run osmo-hlr_10.42.42.2(pid=3773): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3773)] 00:43:52.262517 run osmo-hlr_10.42.42.2(pid=3773): stdout: | (launched: 2022-12-10_00:43:49.321478) 00:43:52.312819 run osmo-hlr_10.42.42.2(pid=3773): stderr: | 20221210004349501 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004349501 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004349501 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004349501 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004349501 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004349501 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004349520 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004349530 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004349530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004349530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:43:52.382666 run osmo-msc_10.42.42.6(pid=3779): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3779)] 00:43:52.431242 run osmo-msc_10.42.42.6(pid=3779): stdout: | (launched: 2022-12-10_00:43:51.278781) 00:43:52.481468 run osmo-msc_10.42.42.6(pid=3779): stderr: | 20221210004351552 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210004351552 DLGLOBAL DEBUG validating counter group 0x7fd55beffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210004351553 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210004351553 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210004351553 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210004351553 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210004351555 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210004351556 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210004351556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210004351556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:43:52.531971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3772): Terminating (SIGTERM) 00:43:52.572584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3775): Terminating (SIGTERM) 00:43:52.613132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3778): Terminating (SIGTERM) 00:43:52.653784 --- ParallelTerminationStrategy: PID 3772 died... 00:43:52.673151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3772): Terminated: ok {rc=0} 00:43:52.717960 --- ParallelTerminationStrategy: PID 3775 died... 00:43:52.736539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3775): Terminated: ok {rc=0} 00:43:52.781342 --- ParallelTerminationStrategy: PID 3778 died... 00:43:52.800084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3778): Terminated: ok {rc=0} 00:43:52.886992 bus /sierra_3: Setting Powered False 00:43:53.988309 bus /sierra_3: Setting Powered False 00:43:55.107119 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 00:43:56.347265 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:43:56.353754 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 00:43:56.375067 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 00:43:56.402243 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 00:43:56.455353 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 00:43:56.477113 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 00:43:56.504529 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 00:43:57.050646 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 00:43:57.100161 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:43:57.111145 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 00:43:57.171653 tst mo_mt_call.py: using LAC 24801 00:43:57.300296 tst mo_mt_call.py: using RAC 66 00:43:57.432591 tst mo_mt_call.py: using CellId 24801 00:43:57.565332 tst mo_mt_call.py: using BVCI 24802 00:43:57.687165 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:43:57.698928 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:43:57.710630 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:43:57.722209 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:43:57.733660 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:43:57.744879 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:43:57.862671 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:43:57.983199 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:43:58.497113 run create_hlr_db(pid=3785): Launched 00:43:58.632931 bus /sierra_2: Setting Powered False 00:43:59.697650 run create_hlr_db(pid=3785): Terminated: ok {rc=0} 00:44:00.138580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3787): Launched 00:44:00.450993 run osmo-hlr_10.42.42.2(pid=3788): Launched 00:44:00.569459 run osmo-stp_10.42.42.5: Starting osmo-stp 00:44:01.130108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3790): Launched 00:44:01.458450 run osmo-stp_10.42.42.5(pid=3791): Launched 00:44:01.639531 run osmo-msc_10.42.42.6: Starting osmo-msc 00:44:02.293551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3793): Launched 00:44:02.609563 run osmo-msc_10.42.42.6(pid=3794): Launched 00:44:02.786737 run osmo-stp_10.42.42.5(pid=3791): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3791)] 00:44:02.919140 run osmo-stp_10.42.42.5(pid=3791): stdout: | (launched: 2022-12-10_00:44:01.399093) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:44:03.051090 run osmo-stp_10.42.42.5(pid=3791): stderr: | 20221210004401746 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004401746 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004401746 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004401747 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004401747 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004401747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004401747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:44:03.180703 run osmo-stp_10.42.42.5(pid=3791): stdout: | (launched: 2022-12-10_00:44:01.399093) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:44:03.304687 run osmo-stp_10.42.42.5(pid=3791): stderr: | 20221210004401746 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004401746 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004401746 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004401747 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004401747 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004401747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004401747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:44:03.453376 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3791): Process ended prematurely: osmo-stp_10.42.42.5(pid=3791) [trial-2367↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3791)] [trial-2367↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 00:44:03.462190 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 00:44:03.489855 run osmo-hlr_10.42.42.2(pid=3788): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3788)] 00:44:03.538660 run osmo-hlr_10.42.42.2(pid=3788): stdout: | (launched: 2022-12-10_00:44:00.392811) 00:44:03.589376 run osmo-hlr_10.42.42.2(pid=3788): stderr: | 20221210004400574 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004400574 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004400574 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004400574 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004400574 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004400574 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004400587 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004400596 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004400596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004400596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:44:03.659774 run osmo-msc_10.42.42.6(pid=3794): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3794)] 00:44:03.708530 run osmo-msc_10.42.42.6(pid=3794): stdout: | (launched: 2022-12-10_00:44:02.551062) 00:44:03.758966 run osmo-msc_10.42.42.6(pid=3794): stderr: | 20221210004402825 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210004402825 DLGLOBAL DEBUG validating counter group 0x7ff3a9fafc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210004402826 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210004402826 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210004402826 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210004402826 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210004402828 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210004402828 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210004402828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210004402828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:44:03.810184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3787): Terminating (SIGTERM) 00:44:03.850941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3790): Terminating (SIGTERM) 00:44:03.892004 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3793): Terminating (SIGTERM) 00:44:03.932785 --- ParallelTerminationStrategy: PID 3787 died... 00:44:03.951924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3787): Terminated: ok {rc=0} 00:44:03.997507 --- ParallelTerminationStrategy: PID 3790 died... 00:44:04.015970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3790): Terminated: ok {rc=0} 00:44:04.061674 --- ParallelTerminationStrategy: PID 3793 died... 00:44:04.080274 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3793): Terminated: ok {rc=0} 00:44:04.168884 bus /sierra_3: Setting Powered False 00:44:05.268939 bus /sierra_3: Setting Powered False 00:44:06.385143 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 00:44:07.535606 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:44:07.550008 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 00:44:07.605643 tst mo_mt_call_osmux.py: using LAC 24802 00:44:07.726679 tst mo_mt_call_osmux.py: using RAC 67 00:44:07.850452 tst mo_mt_call_osmux.py: using CellId 24802 00:44:07.972656 tst mo_mt_call_osmux.py: using BVCI 24803 00:44:08.084449 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:44:08.095542 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:44:08.106544 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:44:08.117691 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:44:08.128654 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:44:08.139952 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:44:08.255238 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:44:08.373375 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:44:08.854134 run create_hlr_db(pid=3797): Launched 00:44:08.971244 bus /sierra_2: Setting Powered False 00:44:10.031547 run create_hlr_db(pid=3797): Terminated: ok {rc=0} 00:44:10.462734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3799): Launched 00:44:10.774023 run osmo-hlr_10.42.42.2(pid=3800): Launched 00:44:10.892699 run osmo-stp_10.42.42.5: Starting osmo-stp 00:44:11.441661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3802): Launched 00:44:11.752260 run osmo-stp_10.42.42.5(pid=3803): Launched 00:44:11.873730 run osmo-msc_10.42.42.6: Starting osmo-msc 00:44:12.432894 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3805): Launched 00:44:12.745320 run osmo-msc_10.42.42.6(pid=3806): Launched 00:44:12.919185 run osmo-stp_10.42.42.5(pid=3803): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3803)] 00:44:13.050199 run osmo-stp_10.42.42.5(pid=3803): stdout: | (launched: 2022-12-10_00:44:11.693915) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:44:13.180351 run osmo-stp_10.42.42.5(pid=3803): stderr: | 20221210004411867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004411867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004411867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004411868 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004411868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004411868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004411868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:44:13.308510 run osmo-stp_10.42.42.5(pid=3803): stdout: | (launched: 2022-12-10_00:44:11.693915) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:44:13.431600 run osmo-stp_10.42.42.5(pid=3803): stderr: | 20221210004411867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004411867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004411867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004411868 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004411868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004411868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004411868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:44:13.578419 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3803): Process ended prematurely: osmo-stp_10.42.42.5(pid=3803) [trial-2367↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3803)] [trial-2367↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 00:44:13.587558 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 00:44:13.614622 run osmo-hlr_10.42.42.2(pid=3800): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3800)] 00:44:13.663072 run osmo-hlr_10.42.42.2(pid=3800): stdout: | (launched: 2022-12-10_00:44:10.715836) 00:44:13.713293 run osmo-hlr_10.42.42.2(pid=3800): stderr: | 20221210004410896 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004410896 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004410896 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004410896 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004410896 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004410896 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004410910 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004410918 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004410918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004410918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:44:13.782724 run osmo-msc_10.42.42.6(pid=3806): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3806)] 00:44:13.830823 run osmo-msc_10.42.42.6(pid=3806): stdout: | (launched: 2022-12-10_00:44:12.687042) 00:44:13.881595 run osmo-msc_10.42.42.6(pid=3806): stderr: | 20221210004412963 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210004412963 DLGLOBAL DEBUG validating counter group 0x7f02d48f1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210004412963 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210004412963 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210004412963 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210004412964 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210004412965 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210004412966 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210004412966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210004412966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:44:13.931888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3799): Terminating (SIGTERM) 00:44:13.971857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3802): Terminating (SIGTERM) 00:44:14.011988 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3805): Terminating (SIGTERM) 00:44:14.052275 --- ParallelTerminationStrategy: PID 3799 died... 00:44:14.071384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3799): Terminated: ok {rc=0} 00:44:14.115991 --- ParallelTerminationStrategy: PID 3802 died... 00:44:14.134695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3802): Terminated: ok {rc=0} 00:44:14.179699 --- ParallelTerminationStrategy: PID 3805 died... 00:44:14.198419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3805): Terminated: ok {rc=0} 00:44:14.284715 bus /sierra_3: Setting Powered False 00:44:15.383596 bus /sierra_3: Setting Powered False 00:44:16.500646 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 00:44:17.749228 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:44:17.756250 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 00:44:17.777840 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 00:44:17.805058 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 00:44:17.859696 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 00:44:17.881733 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 00:44:17.908899 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 00:44:18.458136 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 00:44:18.510667 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:18.522234 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 00:44:18.579921 tst mo_mt_call.py: using LAC 24803 00:44:18.710842 tst mo_mt_call.py: using RAC 68 00:44:18.841326 tst mo_mt_call.py: using CellId 24803 00:44:18.970702 tst mo_mt_call.py: using BVCI 24804 00:44:19.091728 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:19.103330 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:19.114703 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:19.126294 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:19.137690 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:19.149821 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:44:19.265433 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:44:19.381611 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:44:19.862130 run create_hlr_db(pid=3811): Launched 00:44:19.981729 bus /sierra_2: Setting Powered False 00:44:21.042858 run create_hlr_db(pid=3811): Terminated: ok {rc=0} 00:44:21.494401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3813): Launched 00:44:21.827453 run osmo-hlr_10.42.42.2(pid=3814): Launched 00:44:21.956309 run osmo-stp_10.42.42.5: Starting osmo-stp 00:44:22.528168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3816): Launched 00:44:22.861205 run osmo-stp_10.42.42.5(pid=3817): Launched 00:44:22.988073 run osmo-msc_10.42.42.6: Starting osmo-msc 00:44:23.586297 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3819): Launched 00:44:23.920068 run osmo-msc_10.42.42.6(pid=3820): Launched 00:44:24.106064 run osmo-stp_10.42.42.5(pid=3817): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3817)] 00:44:24.247694 run osmo-stp_10.42.42.5(pid=3817): stdout: | (launched: 2022-12-10_00:44:22.799572) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:44:24.386830 run osmo-stp_10.42.42.5(pid=3817): stderr: | 20221210004422995 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004422995 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004422996 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004422996 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004422998 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004422998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004422998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:44:24.524482 run osmo-stp_10.42.42.5(pid=3817): stdout: | (launched: 2022-12-10_00:44:22.799572) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:44:24.656004 run osmo-stp_10.42.42.5(pid=3817): stderr: | 20221210004422995 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004422995 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004422996 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004422996 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004422998 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004422998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004422998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:44:24.813236 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3817): Process ended prematurely: osmo-stp_10.42.42.5(pid=3817) [trial-2367↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3817)] [trial-2367↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 00:44:24.822624 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 00:44:24.850311 run osmo-hlr_10.42.42.2(pid=3814): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3814)] 00:44:24.900133 run osmo-hlr_10.42.42.2(pid=3814): stdout: | (launched: 2022-12-10_00:44:21.766041) 00:44:24.952152 run osmo-hlr_10.42.42.2(pid=3814): stderr: | 20221210004421968 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004421968 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004421968 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004421968 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004421968 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004421968 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004421980 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004421988 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004421989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004421989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:44:25.024045 run osmo-msc_10.42.42.6(pid=3820): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3820)] 00:44:25.074045 run osmo-msc_10.42.42.6(pid=3820): stdout: | (launched: 2022-12-10_00:44:23.857850) 00:44:25.125628 run osmo-msc_10.42.42.6(pid=3820): stderr: | 20221210004424186 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210004424186 DLGLOBAL DEBUG validating counter group 0x7ff0ea4d8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210004424186 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210004424186 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210004424186 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210004424186 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210004424188 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210004424188 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210004424188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210004424188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:44:25.177695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3813): Terminating (SIGTERM) 00:44:25.219404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3816): Terminating (SIGTERM) 00:44:25.260888 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3819): Terminating (SIGTERM) 00:44:25.303187 --- ParallelTerminationStrategy: PID 3813 died... 00:44:25.323188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3813): Terminated: ok {rc=0} 00:44:25.368927 --- ParallelTerminationStrategy: PID 3816 died... 00:44:25.388393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3816): Terminated: ok {rc=0} 00:44:25.434497 --- ParallelTerminationStrategy: PID 3819 died... 00:44:25.454551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3819): Terminated: ok {rc=0} 00:44:25.542093 bus /sierra_3: Setting Powered False 00:44:26.641399 bus /sierra_3: Setting Powered False 00:44:27.760152 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 00:44:28.910889 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:28.923370 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 00:44:28.981155 tst mo_mt_call_osmux.py: using LAC 24804 00:44:29.111849 tst mo_mt_call_osmux.py: using RAC 69 00:44:29.240991 tst mo_mt_call_osmux.py: using CellId 24804 00:44:29.368816 tst mo_mt_call_osmux.py: using BVCI 24805 00:44:29.482477 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:29.493944 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:29.505066 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:29.517176 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:29.528695 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:29.540502 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:44:29.663262 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:44:29.783129 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:44:30.263372 run create_hlr_db(pid=3822): Launched 00:44:30.382989 bus /sierra_2: Setting Powered False 00:44:31.443301 run create_hlr_db(pid=3822): Terminated: ok {rc=0} 00:44:31.904192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3824): Launched 00:44:32.236609 run osmo-hlr_10.42.42.2(pid=3825): Launched 00:44:32.364507 run osmo-stp_10.42.42.5: Starting osmo-stp 00:44:32.933995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3827): Launched 00:44:33.266574 run osmo-stp_10.42.42.5(pid=3828): Launched 00:44:33.391601 run osmo-msc_10.42.42.6: Starting osmo-msc 00:44:33.988417 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3830): Launched 00:44:34.322246 run osmo-msc_10.42.42.6(pid=3831): Launched 00:44:34.507057 run osmo-stp_10.42.42.5(pid=3828): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3828)] 00:44:34.647188 run osmo-stp_10.42.42.5(pid=3828): stdout: | (launched: 2022-12-10_00:44:33.205093) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:44:34.785862 run osmo-stp_10.42.42.5(pid=3828): stderr: | 20221210004433400 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004433400 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004433400 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004433401 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004433401 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004433401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004433401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:44:34.924274 run osmo-stp_10.42.42.5(pid=3828): stdout: | (launched: 2022-12-10_00:44:33.205093) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:44:35.055729 run osmo-stp_10.42.42.5(pid=3828): stderr: | 20221210004433400 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004433400 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004433400 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004433401 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004433401 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004433401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004433401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:44:35.213959 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3828): Process ended prematurely: osmo-stp_10.42.42.5(pid=3828) [trial-2367↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3828)] [trial-2367↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 00:44:35.223309 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 00:44:35.250857 run osmo-hlr_10.42.42.2(pid=3825): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3825)] 00:44:35.300881 run osmo-hlr_10.42.42.2(pid=3825): stdout: | (launched: 2022-12-10_00:44:32.177777) 00:44:35.352704 run osmo-hlr_10.42.42.2(pid=3825): stderr: | 20221210004432375 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004432375 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004432375 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004432375 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004432375 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004432375 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004432387 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004432396 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004432396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004432396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:44:35.424538 run osmo-msc_10.42.42.6(pid=3831): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3831)] 00:44:35.474374 run osmo-msc_10.42.42.6(pid=3831): stdout: | (launched: 2022-12-10_00:44:34.260162) 00:44:35.526020 run osmo-msc_10.42.42.6(pid=3831): stderr: | 20221210004434589 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210004434589 DLGLOBAL DEBUG validating counter group 0x7fa9ea244c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210004434589 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210004434589 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210004434589 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210004434589 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210004434591 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210004434591 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210004434592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210004434592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:44:35.578480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3824): Terminating (SIGTERM) 00:44:35.620125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3827): Terminating (SIGTERM) 00:44:35.661937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3830): Terminating (SIGTERM) 00:44:35.703527 --- ParallelTerminationStrategy: PID 3824 died... 00:44:35.723414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3824): Terminated: ok {rc=0} 00:44:35.769396 --- ParallelTerminationStrategy: PID 3827 died... 00:44:35.788912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3827): Terminated: ok {rc=0} 00:44:35.834984 --- ParallelTerminationStrategy: PID 3830 died... 00:44:35.854537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3830): Terminated: ok {rc=0} 00:44:35.941704 bus /sierra_3: Setting Powered False 00:44:37.037943 bus /sierra_3: Setting Powered False 00:44:38.153585 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 00:44:39.391071 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:44:39.398282 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 00:44:39.419462 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 00:44:39.446762 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 00:44:39.499922 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 00:44:39.521265 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 00:44:39.548392 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 00:44:40.102045 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 00:44:40.155245 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:44:40.167021 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:44:40.224739 tst mo_mt_call.py: using LAC 24805 00:44:40.355733 tst mo_mt_call.py: using RAC 70 00:44:40.484563 tst mo_mt_call.py: using CellId 24805 00:44:40.614392 tst mo_mt_call.py: using BVCI 24806 00:44:40.734892 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:44:40.746638 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:44:40.758084 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:44:40.769529 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:44:40.780936 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:44:40.792405 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:44:40.909642 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:44:41.026334 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:44:41.507775 run create_hlr_db(pid=3836): Launched 00:44:41.628321 bus /sierra_2: Setting Powered False 00:44:42.690972 run create_hlr_db(pid=3836): Terminated: ok {rc=0} 00:44:43.145548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3838): Launched 00:44:43.481583 run osmo-hlr_10.42.42.2(pid=3839): Launched 00:44:43.611251 run osmo-stp_10.42.42.5: Starting osmo-stp 00:44:44.183917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3841): Launched 00:44:44.516620 run osmo-stp_10.42.42.5(pid=3842): Launched 00:44:44.644769 run osmo-msc_10.42.42.6: Starting osmo-msc 00:44:45.246384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3844): Launched 00:44:45.579555 run osmo-msc_10.42.42.6(pid=3845): Launched 00:44:45.765994 run osmo-stp_10.42.42.5(pid=3842): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3842)] 00:44:46.031878 run osmo-stp_10.42.42.5(pid=3842): stdout: | (launched: 2022-12-10_00:44:44.454892) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:44:46.272018 run osmo-stp_10.42.42.5(pid=3842): stderr: | 20221210004444649 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004444649 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004444649 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004444650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004444652 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004444652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004444652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:44:46.420353 run osmo-stp_10.42.42.5(pid=3842): stdout: | (launched: 2022-12-10_00:44:44.454892) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:44:46.555054 run osmo-stp_10.42.42.5(pid=3842): stderr: | 20221210004444649 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004444649 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004444649 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004444650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004444652 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004444652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004444652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:44:46.716440 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3842): Process ended prematurely: osmo-stp_10.42.42.5(pid=3842) [trial-2367↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3842)] [trial-2367↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 00:44:46.726617 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 00:44:46.755400 run osmo-hlr_10.42.42.2(pid=3839): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3839)] 00:44:46.807038 run osmo-hlr_10.42.42.2(pid=3839): stdout: | (launched: 2022-12-10_00:44:43.419282) 00:44:46.860548 run osmo-hlr_10.42.42.2(pid=3839): stderr: | 20221210004443624 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004443624 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004443624 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004443624 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004443624 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004443624 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004443649 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004443658 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004443658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004443658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:44:46.934797 run osmo-msc_10.42.42.6(pid=3845): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3845)] 00:44:46.986606 run osmo-msc_10.42.42.6(pid=3845): stdout: | (launched: 2022-12-10_00:44:45.517573) 00:44:47.040094 run osmo-msc_10.42.42.6(pid=3845): stderr: | 20221210004445845 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210004445845 DLGLOBAL DEBUG validating counter group 0x7fbd955d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210004445845 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210004445845 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210004445845 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210004445845 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210004445847 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210004445847 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210004445848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210004445848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:44:47.093892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3838): Terminating (SIGTERM) 00:44:47.137497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3841): Terminating (SIGTERM) 00:44:47.182026 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3844): Terminating (SIGTERM) 00:44:47.225317 --- ParallelTerminationStrategy: PID 3838 died... 00:44:47.245522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3838): Terminated: ok {rc=0} 00:44:47.292803 --- ParallelTerminationStrategy: PID 3841 died... 00:44:47.313133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3841): Terminated: ok {rc=0} 00:44:47.360489 --- ParallelTerminationStrategy: PID 3844 died... 00:44:47.380095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3844): Terminated: ok {rc=0} 00:44:47.469251 bus /sierra_3: Setting Powered False 00:44:48.567245 bus /sierra_3: Setting Powered False 00:44:49.685597 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 00:44:50.837571 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:44:50.850013 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:44:50.909586 tst mo_mt_call_osmux.py: using LAC 24806 00:44:51.040560 tst mo_mt_call_osmux.py: using RAC 71 00:44:51.171281 tst mo_mt_call_osmux.py: using CellId 24806 00:44:51.301453 tst mo_mt_call_osmux.py: using BVCI 24807 00:44:51.423760 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:44:51.435399 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:44:51.446949 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:44:51.458432 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:44:51.469945 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:44:51.481508 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:44:51.601572 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:44:51.718637 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:44:52.199736 run create_hlr_db(pid=3847): Launched 00:44:52.319592 bus /sierra_2: Setting Powered False 00:44:53.381198 run create_hlr_db(pid=3847): Terminated: ok {rc=0} 00:44:53.834874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3849): Launched 00:44:54.169250 run osmo-hlr_10.42.42.2(pid=3850): Launched 00:44:54.296628 run osmo-stp_10.42.42.5: Starting osmo-stp 00:44:54.867225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3852): Launched 00:44:55.199791 run osmo-stp_10.42.42.5(pid=3853): Launched 00:44:55.326802 run osmo-msc_10.42.42.6: Starting osmo-msc 00:44:55.926952 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3855): Launched 00:44:56.260850 run osmo-msc_10.42.42.6(pid=3856): Launched 00:44:56.446740 run osmo-stp_10.42.42.5(pid=3853): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3853)] 00:44:56.585500 run osmo-stp_10.42.42.5(pid=3853): stdout: | (launched: 2022-12-10_00:44:55.138152) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:44:56.724500 run osmo-stp_10.42.42.5(pid=3853): stderr: | 20221210004455333 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004455333 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004455333 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004455334 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004455334 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004455334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004455334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:44:56.862599 run osmo-stp_10.42.42.5(pid=3853): stdout: | (launched: 2022-12-10_00:44:55.138152) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:44:56.994127 run osmo-stp_10.42.42.5(pid=3853): stderr: | 20221210004455333 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004455333 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004455333 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004455334 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004455334 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004455334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004455334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:44:57.151537 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3853): Process ended prematurely: osmo-stp_10.42.42.5(pid=3853) [trial-2367↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3853)] [trial-2367↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 00:44:57.160882 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 00:44:57.188698 run osmo-hlr_10.42.42.2(pid=3850): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3850)] 00:44:57.239236 run osmo-hlr_10.42.42.2(pid=3850): stdout: | (launched: 2022-12-10_00:44:54.107007) 00:44:57.291475 run osmo-hlr_10.42.42.2(pid=3850): stderr: | 20221210004454307 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004454307 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004454307 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004454307 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004454307 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004454308 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004454319 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004454329 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004454329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004454329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:44:57.364361 run osmo-msc_10.42.42.6(pid=3856): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3856)] 00:44:57.414778 run osmo-msc_10.42.42.6(pid=3856): stdout: | (launched: 2022-12-10_00:44:56.198935) 00:44:57.466671 run osmo-msc_10.42.42.6(pid=3856): stderr: | 20221210004456524 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210004456524 DLGLOBAL DEBUG validating counter group 0x7f1128361c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210004456524 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210004456524 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210004456525 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210004456525 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210004456526 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210004456527 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210004456527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210004456527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:44:57.518939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3849): Terminating (SIGTERM) 00:44:57.560841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3852): Terminating (SIGTERM) 00:44:57.603140 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3855): Terminating (SIGTERM) 00:44:57.645232 --- ParallelTerminationStrategy: PID 3849 died... 00:44:57.665319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3849): Terminated: ok {rc=0} 00:44:57.711508 --- ParallelTerminationStrategy: PID 3852 died... 00:44:57.731065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3852): Terminated: ok {rc=0} 00:44:57.777160 --- ParallelTerminationStrategy: PID 3855 died... 00:44:57.796453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3855): Terminated: ok {rc=0} 00:44:57.883816 bus /sierra_3: Setting Powered False 00:44:58.982470 bus /sierra_3: Setting Powered False 00:45:00.100812 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 00:45:01.340738 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:45:01.350470 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 00:45:01.378406 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 00:45:01.413329 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 00:45:01.475192 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 00:45:01.498192 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 00:45:01.527687 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 00:45:02.074060 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 00:45:02.130291 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:02.142231 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:45:02.202506 tst mo_mt_call.py: using LAC 24807 00:45:02.325905 tst mo_mt_call.py: using RAC 72 00:45:02.449578 tst mo_mt_call.py: using CellId 24807 00:45:02.579528 tst mo_mt_call.py: using BVCI 24808 00:45:02.701647 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:02.713148 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:02.724272 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:02.735342 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:02.746507 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:02.757708 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:45:02.874654 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:45:02.999133 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:45:03.515151 run create_hlr_db(pid=3865): Launched 00:45:03.650213 bus /sierra_2: Setting Powered False 00:45:04.715578 run create_hlr_db(pid=3865): Terminated: ok {rc=0} 00:45:05.177024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3867): Launched 00:45:05.510771 run osmo-hlr_10.42.42.2(pid=3868): Launched 00:45:05.638308 run osmo-stp_10.42.42.5: Starting osmo-stp 00:45:06.177907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3870): Launched 00:45:06.490754 run osmo-stp_10.42.42.5(pid=3871): Launched 00:45:06.611958 run osmo-msc_10.42.42.6: Starting osmo-msc 00:45:07.172584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3873): Launched 00:45:07.484274 run osmo-msc_10.42.42.6(pid=3874): Launched 00:45:07.659230 run osmo-stp_10.42.42.5(pid=3871): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3871)] 00:45:07.790870 run osmo-stp_10.42.42.5(pid=3871): stdout: | (launched: 2022-12-10_00:45:06.432669) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:45:07.921632 run osmo-stp_10.42.42.5(pid=3871): stderr: | 20221210004506605 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004506605 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004506606 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004506606 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004506606 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004506607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004506607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:45:08.050519 run osmo-stp_10.42.42.5(pid=3871): stdout: | (launched: 2022-12-10_00:45:06.432669) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:45:08.173948 run osmo-stp_10.42.42.5(pid=3871): stderr: | 20221210004506605 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004506605 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004506606 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004506606 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004506606 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004506607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004506607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:45:08.321937 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3871): Process ended prematurely: osmo-stp_10.42.42.5(pid=3871) [trial-2367↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3871)] [trial-2367↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 00:45:08.330950 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 00:45:08.357532 run osmo-hlr_10.42.42.2(pid=3868): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3868)] 00:45:08.405820 run osmo-hlr_10.42.42.2(pid=3868): stdout: | (launched: 2022-12-10_00:45:05.448817) 00:45:08.455661 run osmo-hlr_10.42.42.2(pid=3868): stderr: | 20221210004505652 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004505652 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004505652 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004505652 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004505653 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004505653 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004505667 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004505675 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004505675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004505676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:45:08.524861 run osmo-msc_10.42.42.6(pid=3874): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3874)] 00:45:08.573135 run osmo-msc_10.42.42.6(pid=3874): stdout: | (launched: 2022-12-10_00:45:07.426173) 00:45:08.623201 run osmo-msc_10.42.42.6(pid=3874): stderr: | 20221210004507703 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210004507703 DLGLOBAL DEBUG validating counter group 0x7f92d4146c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210004507703 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210004507703 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210004507704 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210004507704 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210004507706 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210004507706 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210004507706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210004507706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:45:08.673442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3867): Terminating (SIGTERM) 00:45:08.713645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3870): Terminating (SIGTERM) 00:45:08.753927 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3873): Terminating (SIGTERM) 00:45:08.794814 --- ParallelTerminationStrategy: PID 3867 died... 00:45:08.814182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3867): Terminated: ok {rc=0} 00:45:08.859350 --- ParallelTerminationStrategy: PID 3870 died... 00:45:08.878168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3870): Terminated: ok {rc=0} 00:45:08.923089 --- ParallelTerminationStrategy: PID 3873 died... 00:45:08.941902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3873): Terminated: ok {rc=0} 00:45:09.028437 bus /sierra_3: Setting Powered False 00:45:10.129531 bus /sierra_3: Setting Powered False 00:45:11.244517 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 00:45:12.396141 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:12.408261 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:45:12.467322 tst mo_mt_call_osmux.py: using LAC 24808 00:45:12.597369 tst mo_mt_call_osmux.py: using RAC 73 00:45:12.727524 tst mo_mt_call_osmux.py: using CellId 24808 00:45:12.858209 tst mo_mt_call_osmux.py: using BVCI 24809 00:45:12.979452 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:12.991027 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:13.002224 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:13.013435 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:13.024574 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:13.035803 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:45:13.156532 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:45:13.278155 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:45:13.794167 run create_hlr_db(pid=3876): Launched 00:45:13.929472 bus /sierra_2: Setting Powered False 00:45:14.994964 run create_hlr_db(pid=3876): Terminated: ok {rc=0} 00:45:15.455119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3878): Launched 00:45:15.787035 run osmo-hlr_10.42.42.2(pid=3879): Launched 00:45:15.909780 run osmo-stp_10.42.42.5: Starting osmo-stp 00:45:16.714358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3881): Launched 00:45:17.048395 run osmo-stp_10.42.42.5(pid=3882): Launched 00:45:17.250590 run osmo-msc_10.42.42.6: Starting osmo-msc 00:45:17.959390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3884): Launched 00:45:18.292010 run osmo-msc_10.42.42.6(pid=3885): Launched 00:45:18.477377 run osmo-stp_10.42.42.5(pid=3882): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3882)] 00:45:18.615917 run osmo-stp_10.42.42.5(pid=3882): stdout: | (launched: 2022-12-10_00:45:16.989088) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:45:18.754441 run osmo-stp_10.42.42.5(pid=3882): stderr: | 20221210004517276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004517276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004517276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004517277 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004517277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004517277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004517277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:45:18.891847 run osmo-stp_10.42.42.5(pid=3882): stdout: | (launched: 2022-12-10_00:45:16.989088) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:45:19.023439 run osmo-stp_10.42.42.5(pid=3882): stderr: | 20221210004517276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004517276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004517276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004517277 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004517277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004517277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004517277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:45:19.180535 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3882): Process ended prematurely: osmo-stp_10.42.42.5(pid=3882) [trial-2367↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3882)] [trial-2367↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 00:45:19.190151 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 00:45:19.217795 run osmo-hlr_10.42.42.2(pid=3879): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3879)] 00:45:19.268039 run osmo-hlr_10.42.42.2(pid=3879): stdout: | (launched: 2022-12-10_00:45:15.725430) 00:45:19.320188 run osmo-hlr_10.42.42.2(pid=3879): stderr: | 20221210004516027 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004516027 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004516028 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004516028 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004516028 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004516028 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004516051 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004516066 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004516066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004516067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:45:19.392730 run osmo-msc_10.42.42.6(pid=3885): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3885)] 00:45:19.442866 run osmo-msc_10.42.42.6(pid=3885): stdout: | (launched: 2022-12-10_00:45:18.230309) 00:45:19.494695 run osmo-msc_10.42.42.6(pid=3885): stderr: | 20221210004518559 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210004518559 DLGLOBAL DEBUG validating counter group 0x7f1d661bac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210004518559 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210004518559 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210004518559 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210004518560 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210004518561 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210004518562 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210004518562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210004518562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:45:19.547245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3878): Terminating (SIGTERM) 00:45:19.589181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3881): Terminating (SIGTERM) 00:45:19.631525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3884): Terminating (SIGTERM) 00:45:19.673920 --- ParallelTerminationStrategy: PID 3878 died... 00:45:19.693903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3878): Terminated: ok {rc=0} 00:45:19.740053 --- ParallelTerminationStrategy: PID 3881 died... 00:45:19.759575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3881): Terminated: ok {rc=0} 00:45:19.805488 --- ParallelTerminationStrategy: PID 3884 died... 00:45:19.825022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3884): Terminated: ok {rc=0} 00:45:19.912679 bus /sierra_3: Setting Powered False 00:45:21.011775 bus /sierra_3: Setting Powered False 00:45:22.129376 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 emergency:sysmo --------------------------------------------------------------------- 00:45:23.362193 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:45:23.366531 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 00:45:23.387422 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 00:45:23.415232 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 00:45:23.503846 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 00:45:23.524682 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 00:45:23.551316 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 00:45:24.129190 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2367 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 00:45:24.134114 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:45:24.144676 tst emergency:sysmo: Using 1 x bts (candidates: 1) 00:45:24.180871 tst emergency_mo_mt_call.py: using LAC 24809 00:45:24.298345 tst emergency_mo_mt_call.py: using RAC 74 00:45:24.417930 tst emergency_mo_mt_call.py: using CellId 24809 00:45:24.537468 tst emergency_mo_mt_call.py: using BVCI 24810 00:45:24.649343 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:45:24.659907 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:45:24.670478 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:45:24.681180 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:45:24.691845 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:45:24.702505 tst emergency:sysmo: Using 1 x modem (candidates: 4) 00:45:24.822801 tst emergency:sysmo: Using 1 x modem (candidates: 4) 00:45:24.938503 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:45:25.411022 run create_hlr_db(pid=3890): Launched 00:45:25.527959 bus /sierra_2: Setting Powered False 00:45:26.589319 run create_hlr_db(pid=3890): Terminated: ok {rc=0} 00:45:27.035189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3892): Launched 00:45:27.364050 run osmo-hlr_10.42.42.2(pid=3893): Launched 00:45:27.487945 run osmo-stp_10.42.42.5: Starting osmo-stp 00:45:28.052222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3895): Launched 00:45:28.380932 run osmo-stp_10.42.42.5(pid=3896): Launched 00:45:28.517050 tst emergency_mo_mt_call.py: using MSISDN 7467 00:45:28.685789 run osmo-msc_10.42.42.6: Starting osmo-msc 00:45:29.271235 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3898): Launched 00:45:29.597625 run osmo-msc_10.42.42.6(pid=3899): Launched 00:45:29.779941 run osmo-stp_10.42.42.5(pid=3896): ERR: Terminated: ERROR {rc=1} [trial-2367↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3896)] 00:45:29.917253 run osmo-stp_10.42.42.5(pid=3896): stdout: | (launched: 2022-12-10_00:45:28.319738) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:45:30.054260 run osmo-stp_10.42.42.5(pid=3896): stderr: | 20221210004528515 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004528515 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004528515 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004528516 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004528516 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004528516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004528516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:45:30.190408 run osmo-stp_10.42.42.5(pid=3896): stdout: | (launched: 2022-12-10_00:45:28.319738) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:45:30.319815 run osmo-stp_10.42.42.5(pid=3896): stderr: | 20221210004528515 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004528515 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004528515 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004528516 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004528516 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004528516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004528516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:45:30.474525 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=3896): Process ended prematurely: osmo-stp_10.42.42.5(pid=3896) [trial-2367↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3896)] [trial-2367↪emergency:sysmo↪emergency_mo_mt_call.py:19] 00:45:30.483514 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 00:45:30.510887 run osmo-hlr_10.42.42.2(pid=3893): ERR: Terminated: ERROR {rc=237} [trial-2367↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3893)] 00:45:30.561283 run osmo-hlr_10.42.42.2(pid=3893): stdout: | (launched: 2022-12-10_00:45:27.302720) 00:45:30.613543 run osmo-hlr_10.42.42.2(pid=3893): stderr: | 20221210004527503 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004527503 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004527503 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004527503 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004527503 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004527503 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004527517 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004527525 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004527525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004527525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:45:30.685868 run osmo-msc_10.42.42.6(pid=3899): ERR: Terminated: ERROR {rc=2} [trial-2367↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3899)] 00:45:30.735889 run osmo-msc_10.42.42.6(pid=3899): stdout: | (launched: 2022-12-10_00:45:29.536320) 00:45:30.787405 run osmo-msc_10.42.42.6(pid=3899): stderr: | 20221210004529865 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210004529865 DLGLOBAL DEBUG validating counter group 0x7fea62bc4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210004529866 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210004529866 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210004529866 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210004529866 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210004529868 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210004529868 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210004529868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210004529868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:45:30.841417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3892): Terminating (SIGTERM) 00:45:30.885253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3895): Terminating (SIGTERM) 00:45:30.932905 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3898): Terminating (SIGTERM) 00:45:30.980024 --- ParallelTerminationStrategy: PID 3892 died... 00:45:31.000509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3892): Terminated: ok {rc=0} 00:45:31.047934 --- ParallelTerminationStrategy: PID 3895 died... 00:45:31.071772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3895): Terminated: ok {rc=0} 00:45:31.119235 --- ParallelTerminationStrategy: PID 3898 died... 00:45:31.139391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3898): Terminated: ok {rc=0} 00:45:31.228016 bus /sierra_3: Setting Powered False 00:45:32.323912 bus /sierra_3: Setting Powered False 00:45:33.439279 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 00:45:34.527071 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:45:34.539183 tst emergency:sysmo: Using 1 x bts (candidates: 1) 00:45:34.577826 tst emergency_preemptive_call.py: using LAC 24810 00:45:34.708899 tst emergency_preemptive_call.py: using RAC 75 00:45:34.835792 tst emergency_preemptive_call.py: using CellId 24810 00:45:34.964097 tst emergency_preemptive_call.py: using BVCI 24811 00:45:35.083798 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:45:35.094931 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:45:35.105963 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:45:35.116915 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:45:35.127876 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:45:35.138856 tst emergency:sysmo: Using 1 x modem (candidates: 4) 00:45:35.260375 tst emergency:sysmo: Using 1 x modem (candidates: 4) 00:45:35.380881 tst emergency:sysmo: Using 1 x modem (candidates: 4) 00:45:35.497869 tst emergency:sysmo: Using 1 x modem (candidates: 4) 00:45:35.613548 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:45:36.085726 run create_hlr_db(pid=3901): Launched 00:45:36.204253 bus /sierra_2: Setting Powered False 00:45:37.263809 run create_hlr_db(pid=3901): Terminated: ok {rc=0} 00:45:37.688554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3903): Launched 00:45:37.995997 run osmo-hlr_10.42.42.2(pid=3904): Launched 00:45:38.113796 run osmo-stp_10.42.42.5: Starting osmo-stp 00:45:38.640827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3906): Launched 00:45:38.947043 run osmo-stp_10.42.42.5(pid=3907): Launched 00:45:39.075517 tst emergency_preemptive_call.py: using MSISDN 7468 00:45:39.230804 run osmo-msc_10.42.42.6: Starting osmo-msc 00:45:39.777083 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3909): Launched 00:45:40.083205 run osmo-msc_10.42.42.6(pid=3910): Launched 00:45:40.262016 run osmo-stp_10.42.42.5(pid=3907): ERR: Terminated: ERROR {rc=1} [trial-2367↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3907)] 00:45:40.391820 run osmo-stp_10.42.42.5(pid=3907): stdout: | (launched: 2022-12-10_00:45:38.889537) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:45:40.520508 run osmo-stp_10.42.42.5(pid=3907): stderr: | 20221210004539062 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004539062 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004539062 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004539063 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004539063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004539063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004539063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:45:40.648005 run osmo-stp_10.42.42.5(pid=3907): stdout: | (launched: 2022-12-10_00:45:38.889537) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:45:40.768549 run osmo-stp_10.42.42.5(pid=3907): stderr: | 20221210004539062 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004539062 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004539062 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004539063 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004539063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004539063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004539063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:45:40.913006 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=3907): Process ended prematurely: osmo-stp_10.42.42.5(pid=3907) [trial-2367↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3907)] [trial-2367↪emergency:sysmo↪emergency_preemptive_call.py:32] 00:45:40.921107 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 00:45:40.947326 run osmo-hlr_10.42.42.2(pid=3904): ERR: Terminated: ERROR {rc=237} [trial-2367↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3904)] 00:45:40.996237 run osmo-hlr_10.42.42.2(pid=3904): stdout: | (launched: 2022-12-10_00:45:37.938446) 00:45:41.046301 run osmo-hlr_10.42.42.2(pid=3904): stderr: | 20221210004538117 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004538117 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004538117 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004538117 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004538117 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004538117 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004538129 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004538138 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004538138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004538138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:45:41.116079 run osmo-msc_10.42.42.6(pid=3910): ERR: Terminated: ERROR {rc=2} [trial-2367↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3910)] 00:45:41.164255 run osmo-msc_10.42.42.6(pid=3910): stdout: | (launched: 2022-12-10_00:45:40.025466) 00:45:41.214102 run osmo-msc_10.42.42.6(pid=3910): stderr: | 20221210004540300 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210004540300 DLGLOBAL DEBUG validating counter group 0x7f3e52297c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210004540300 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210004540300 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210004540300 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210004540300 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210004540302 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210004540303 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210004540303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210004540303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:45:41.264386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3903): Terminating (SIGTERM) 00:45:41.304443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3906): Terminating (SIGTERM) 00:45:41.344528 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3909): Terminating (SIGTERM) 00:45:41.384787 --- ParallelTerminationStrategy: PID 3903 died... 00:45:41.403918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3903): Terminated: ok {rc=0} 00:45:41.448357 --- ParallelTerminationStrategy: PID 3906 died... 00:45:41.467029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3906): Terminated: ok {rc=0} 00:45:41.511421 --- ParallelTerminationStrategy: PID 3909 died... 00:45:41.530045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3909): Terminated: ok {rc=0} 00:45:41.617080 bus /sierra_9: Setting Powered False 00:45:42.717373 bus /sierra_9: Setting Powered False 00:45:43.833364 bus /sierra_8: Setting Powered False 00:45:44.931832 bus /sierra_8: Setting Powered False 00:45:46.058612 bus /sierra_3: Setting Powered False 00:45:47.165949 bus /sierra_3: Setting Powered False 00:45:48.290508 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:sysmo --------------------------------------------------------------------- 00:45:49.558087 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:45:49.562649 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 00:45:49.584010 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 00:45:49.623947 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 00:45:49.712884 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 00:45:49.734606 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 00:45:49.773751 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 00:45:50.365522 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 00:45:50.420150 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:45:50.431104 tst gprs:sysmo: Using 1 x bts (candidates: 1) 00:45:50.467517 tst cs_paging_gprs_active.py: using LAC 24811 00:45:50.601594 tst cs_paging_gprs_active.py: using RAC 76 00:45:50.724895 tst cs_paging_gprs_active.py: using CellId 24811 00:45:50.844906 tst cs_paging_gprs_active.py: using BVCI 24812 00:45:50.957556 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:45:50.968172 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:45:50.978898 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:45:50.989484 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:45:51.001395 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:45:51.012620 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:45:51.023906 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:45:51.035200 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:45:51.046853 tst gprs:sysmo: Using 1 x modem (candidates: 4) 00:45:51.169662 tst gprs:sysmo: Using 1 x modem (candidates: 4) 00:45:51.291365 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:45:51.516161 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:45:51.851946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3915): Launched 00:45:52.141493 run iperf3-srv_10.42.42.10(pid=3916): Launched 00:45:52.267498 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:45:52.491809 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:45:52.827978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3917): Launched 00:45:53.116652 run iperf3-srv_10.42.42.10(pid=3918): Launched 00:45:53.241831 tst cs_paging_gprs_active.py:38: start network... 00:45:53.465058 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:45:53.982285 run create_hlr_db(pid=3919): Launched 00:45:54.119041 bus /sierra_2: Setting Powered False 00:45:55.184062 run create_hlr_db(pid=3919): Terminated: ok {rc=0} 00:45:55.626846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3921): Launched 00:45:55.938747 run osmo-hlr_10.42.42.2(pid=3922): Launched 00:45:56.059018 run osmo-stp_10.42.42.5: Starting osmo-stp 00:45:56.595206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3924): Launched 00:45:56.907901 run osmo-stp_10.42.42.5(pid=3925): Launched 00:45:57.027268 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:45:58.542825 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3927): Launched 00:45:58.662809 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:45:58.927712 run patchelf(pid=3928): Launched 00:45:59.101661 run osmo-stp_10.42.42.5(pid=3925): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3925)] 00:45:59.232876 run osmo-stp_10.42.42.5(pid=3925): stdout: | (launched: 2022-12-10_00:45:56.849684) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:45:59.365706 run osmo-stp_10.42.42.5(pid=3925): stderr: | 20221210004557024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004557024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004557024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004557025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004557025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004557025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004557025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:45:59.498265 run osmo-stp_10.42.42.5(pid=3925): stdout: | (launched: 2022-12-10_00:45:56.849684) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:45:59.625234 run osmo-stp_10.42.42.5(pid=3925): stderr: | 20221210004557024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004557024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004557024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004557025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004557025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004557025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004557025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:45:59.775889 run patchelf(pid=3928): Terminating (SIGINT) 00:45:59.949082 run patchelf(pid=3928): Terminated: ok {rc=0} 00:46:00.073759 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3925): Process ended prematurely: osmo-stp_10.42.42.5(pid=3925) [trial-2367↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3925)] [trial-2367↪gprs:sysmo↪cs_paging_gprs_active.py:38] 00:46:00.083063 tst cs_paging_gprs_active.py:38: Test FAILED (9.7 sec) 00:46:00.110923 run osmo-hlr_10.42.42.2(pid=3922): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3922)] 00:46:00.159107 run osmo-hlr_10.42.42.2(pid=3922): stdout: | (launched: 2022-12-10_00:45:55.880127) 00:46:00.209344 run osmo-hlr_10.42.42.2(pid=3922): stderr: | 20221210004556062 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004556062 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004556062 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004556062 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004556062 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004556062 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004556074 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004556083 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004556084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004556084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:46:00.259762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3915): Terminating (SIGTERM) 00:46:00.300538 run iperf3-srv_10.42.42.10(pid=3916): Terminating (SIGTERM) 00:46:00.340775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3917): Terminating (SIGTERM) 00:46:00.381843 run iperf3-srv_10.42.42.10(pid=3918): Terminating (SIGTERM) 00:46:00.422279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3921): Terminating (SIGTERM) 00:46:00.462651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3924): Terminating (SIGTERM) 00:46:00.503071 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3927): Terminating (SIGTERM) 00:46:00.543441 --- ParallelTerminationStrategy: PID 3915 died... 00:46:00.562635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3915): Terminated: ok {rc=0} 00:46:00.607715 --- ParallelTerminationStrategy: PID 3916 died... 00:46:00.626495 run iperf3-srv_10.42.42.10(pid=3916): Terminated {rc=256} 00:46:00.671016 --- ParallelTerminationStrategy: PID 3917 died... 00:46:00.690157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3917): Terminated: ok {rc=0} 00:46:00.735275 --- ParallelTerminationStrategy: PID 3918 died... 00:46:00.754003 run iperf3-srv_10.42.42.10(pid=3918): Terminated {rc=256} 00:46:00.798651 --- ParallelTerminationStrategy: PID 3921 died... 00:46:00.817636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3921): Terminated: ok {rc=0} 00:46:00.887433 --- ParallelTerminationStrategy: PID 3924 died... 00:46:00.908230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3924): Terminated: ok {rc=0} 00:46:00.959112 --- ParallelTerminationStrategy: PID 3927 died... 00:46:00.979946 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3927): Terminated: ok {rc=0} 00:46:01.078026 bus /gobi_0: Setting Powered False 00:46:02.189001 bus /gobi_0: Setting Powered False 00:46:03.308017 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:sysmo iperf3.py ---------------------------------------------- 00:46:04.462215 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:04.474100 tst gprs:sysmo: Using 1 x bts (candidates: 1) 00:46:04.510989 tst iperf3.py: using LAC 24812 00:46:04.641087 tst iperf3.py: using RAC 77 00:46:04.773372 tst iperf3.py: using CellId 24812 00:46:04.904630 tst iperf3.py: using BVCI 24813 00:46:05.025778 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:05.036681 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:05.047714 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:05.058676 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:05.069514 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:05.080217 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:05.091226 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:05.102288 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:05.113305 tst gprs:sysmo: Using 1 x modem (candidates: 4) 00:46:05.233629 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:46:05.458418 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:46:05.792740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3929): Launched 00:46:06.083687 run iperf3-srv_10.42.42.10(pid=3930): Launched 00:46:06.209490 tst iperf3.py:8: start network... 00:46:06.431988 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:46:06.949461 run create_hlr_db(pid=3931): Launched 00:46:07.085668 bus /gobi_6: Setting Powered False 00:46:08.150365 run create_hlr_db(pid=3931): Terminated: ok {rc=0} 00:46:08.590252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3933): Launched 00:46:08.901847 run osmo-hlr_10.42.42.2(pid=3934): Launched 00:46:09.018848 run osmo-stp_10.42.42.5: Starting osmo-stp 00:46:09.564202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3936): Launched 00:46:09.876092 run osmo-stp_10.42.42.5(pid=3937): Launched 00:46:09.995499 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:46:10.529821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3939): Launched 00:46:10.647844 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:46:10.910618 run patchelf(pid=3940): Launched 00:46:11.083513 run osmo-stp_10.42.42.5(pid=3937): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3937)] 00:46:11.213675 run osmo-stp_10.42.42.5(pid=3937): stdout: | (launched: 2022-12-10_00:46:09.817905) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:46:11.345553 run osmo-stp_10.42.42.5(pid=3937): stderr: | 20221210004609992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004609993 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004609993 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004609993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004609994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004609994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004609994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:46:11.477822 run osmo-stp_10.42.42.5(pid=3937): stdout: | (launched: 2022-12-10_00:46:09.817905) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:46:11.604090 run osmo-stp_10.42.42.5(pid=3937): stderr: | 20221210004609992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004609993 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004609993 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004609993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004609994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004609994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004609994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:46:11.754066 run patchelf(pid=3940): Terminating (SIGINT) 00:46:11.927382 run patchelf(pid=3940): Terminated: ok {rc=0} 00:46:12.051545 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3937): Process ended prematurely: osmo-stp_10.42.42.5(pid=3937) [trial-2367↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3937)] [trial-2367↪gprs:sysmo↪iperf3.py:8] 00:46:12.061161 tst iperf3.py:8: Test FAILED (7.6 sec) 00:46:12.088785 run osmo-hlr_10.42.42.2(pid=3934): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3934)] 00:46:12.137088 run osmo-hlr_10.42.42.2(pid=3934): stdout: | (launched: 2022-12-10_00:46:08.843263) 00:46:12.186960 run osmo-hlr_10.42.42.2(pid=3934): stderr: | 20221210004609024 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004609024 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004609024 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004609024 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004609024 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004609024 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004609037 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004609045 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004609046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004609046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:46:12.237620 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3929): Terminating (SIGTERM) 00:46:12.277659 run iperf3-srv_10.42.42.10(pid=3930): Terminating (SIGTERM) 00:46:12.317459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3933): Terminating (SIGTERM) 00:46:12.357496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3936): Terminating (SIGTERM) 00:46:12.397424 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3939): Terminating (SIGTERM) 00:46:12.437481 --- ParallelTerminationStrategy: PID 3929 died... 00:46:12.456500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3929): Terminated: ok {rc=0} 00:46:12.500926 --- ParallelTerminationStrategy: PID 3930 died... 00:46:12.520000 run iperf3-srv_10.42.42.10(pid=3930): Terminated {rc=256} 00:46:12.564763 --- ParallelTerminationStrategy: PID 3933 died... 00:46:12.583583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3933): Terminated: ok {rc=0} 00:46:12.628186 --- ParallelTerminationStrategy: PID 3936 died... 00:46:12.646973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3936): Terminated: ok {rc=0} 00:46:12.691734 --- ParallelTerminationStrategy: PID 3939 died... 00:46:12.710508 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3939): Terminated: ok {rc=0} 00:46:12.798310 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:sysmo iperf3m4.py ---------------------------------------------- 00:46:13.947618 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:13.958979 tst gprs:sysmo: Using 1 x bts (candidates: 1) 00:46:13.994803 tst iperf3m4.py: using LAC 24813 00:46:14.117232 tst iperf3m4.py: using RAC 78 00:46:14.242527 tst iperf3m4.py: using CellId 24813 00:46:14.362873 tst iperf3m4.py: using BVCI 24814 00:46:14.476310 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:14.486942 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:14.497475 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:14.508223 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:14.518813 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:14.529370 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:14.540091 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:14.550698 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:14.561516 tst gprs:sysmo: Using 1 x modem (candidates: 4) 00:46:14.681706 tst gprs:sysmo: Using 1 x modem (candidates: 4) 00:46:14.805695 tst gprs:sysmo: Using 1 x modem (candidates: 4) 00:46:14.924111 tst gprs:sysmo: Using 1 x modem (candidates: 4) 00:46:15.042401 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:46:15.250283 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:46:15.562245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3941): Launched 00:46:15.845614 run iperf3-srv_10.42.42.10(pid=3942): Launched 00:46:15.991417 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:46:16.228050 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:46:16.577663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3943): Launched 00:46:16.867272 run iperf3-srv_10.42.42.10(pid=3944): Launched 00:46:16.999904 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:46:17.213949 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:46:17.528730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3945): Launched 00:46:17.801720 run iperf3-srv_10.42.42.10(pid=3946): Launched 00:46:17.917787 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:46:18.124206 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:46:18.435947 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3947): Launched 00:46:18.722717 run iperf3-srv_10.42.42.10(pid=3948): Launched 00:46:18.840842 tst iperf3m4.py:8: start network... 00:46:19.048182 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:46:19.531843 run create_hlr_db(pid=3949): Launched 00:46:19.652253 bus /gobi_6: Setting Powered False 00:46:20.713861 run create_hlr_db(pid=3949): Terminated: ok {rc=0} 00:46:21.167291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3951): Launched 00:46:21.500445 run osmo-hlr_10.42.42.2(pid=3952): Launched 00:46:21.629163 run osmo-stp_10.42.42.5: Starting osmo-stp 00:46:22.203215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3954): Launched 00:46:22.536125 run osmo-stp_10.42.42.5(pid=3955): Launched 00:46:22.665595 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:46:23.238866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3957): Launched 00:46:23.364871 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:46:23.646848 run patchelf(pid=3958): Launched 00:46:23.832204 run osmo-stp_10.42.42.5(pid=3955): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3955)] 00:46:23.971813 run osmo-stp_10.42.42.5(pid=3955): stdout: | (launched: 2022-12-10_00:46:22.473678) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:46:24.112882 run osmo-stp_10.42.42.5(pid=3955): stderr: | 20221210004622670 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004622670 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004622670 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004622670 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004622671 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004622671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004622671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:46:24.254359 run osmo-stp_10.42.42.5(pid=3955): stdout: | (launched: 2022-12-10_00:46:22.473678) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:46:24.390378 run osmo-stp_10.42.42.5(pid=3955): stderr: | 20221210004622670 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004622670 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004622670 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004622670 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004622671 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004622671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004622671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:46:24.551166 run patchelf(pid=3958): Terminating (SIGINT) 00:46:24.736059 run patchelf(pid=3958): Terminated: ok {rc=0} 00:46:24.868852 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3955): Process ended prematurely: osmo-stp_10.42.42.5(pid=3955) [trial-2367↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3955)] [trial-2367↪gprs:sysmo↪iperf3m4.py:8] 00:46:24.879264 tst iperf3m4.py:8: Test FAILED (11.0 sec) 00:46:24.908247 run osmo-hlr_10.42.42.2(pid=3952): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3952)] 00:46:24.958844 run osmo-hlr_10.42.42.2(pid=3952): stdout: | (launched: 2022-12-10_00:46:21.438554) 00:46:25.011020 run osmo-hlr_10.42.42.2(pid=3952): stderr: | 20221210004621642 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004621642 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004621642 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004621642 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004621642 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004621642 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004621654 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004621665 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004621665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004621665 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:46:25.063744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3941): Terminating (SIGTERM) 00:46:25.106107 run iperf3-srv_10.42.42.10(pid=3942): Terminating (SIGTERM) 00:46:25.149431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3943): Terminating (SIGTERM) 00:46:25.191512 run iperf3-srv_10.42.42.10(pid=3944): Terminating (SIGTERM) 00:46:25.231726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3945): Terminating (SIGTERM) 00:46:25.271884 run iperf3-srv_10.42.42.10(pid=3946): Terminating (SIGTERM) 00:46:25.311966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3947): Terminating (SIGTERM) 00:46:25.352174 run iperf3-srv_10.42.42.10(pid=3948): Terminating (SIGTERM) 00:46:25.392250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3951): Terminating (SIGTERM) 00:46:25.432246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3954): Terminating (SIGTERM) 00:46:25.472225 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3957): Terminating (SIGTERM) 00:46:25.512564 --- ParallelTerminationStrategy: PID 3941 died... 00:46:25.532016 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3941): Terminated: ok {rc=0} 00:46:25.577462 --- ParallelTerminationStrategy: PID 3942 died... 00:46:25.596344 run iperf3-srv_10.42.42.10(pid=3942): Terminated {rc=256} 00:46:25.640872 --- ParallelTerminationStrategy: PID 3943 died... 00:46:25.659916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3943): Terminated: ok {rc=0} 00:46:25.704860 --- ParallelTerminationStrategy: PID 3944 died... 00:46:25.723977 run iperf3-srv_10.42.42.10(pid=3944): Terminated {rc=256} 00:46:25.768427 --- ParallelTerminationStrategy: PID 3945 died... 00:46:25.787266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3945): Terminated: ok {rc=0} 00:46:25.831948 --- ParallelTerminationStrategy: PID 3946 died... 00:46:25.850848 run iperf3-srv_10.42.42.10(pid=3946): Terminated {rc=256} 00:46:25.895639 --- ParallelTerminationStrategy: PID 3947 died... 00:46:25.914458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3947): Terminated: ok {rc=0} 00:46:25.959005 --- ParallelTerminationStrategy: PID 3948 died... 00:46:25.977851 run iperf3-srv_10.42.42.10(pid=3948): Terminated {rc=256} 00:46:26.022447 --- ParallelTerminationStrategy: PID 3951 died... 00:46:26.041420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3951): Terminated: ok {rc=0} 00:46:26.086275 --- ParallelTerminationStrategy: PID 3954 died... 00:46:26.105330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3954): Terminated: ok {rc=0} 00:46:26.150606 --- ParallelTerminationStrategy: PID 3957 died... 00:46:26.169543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3957): Terminated: ok {rc=0} 00:46:26.256285 bus /gobi_4: Setting Powered False 00:46:27.359959 bus /gobi_4: Setting Powered False 00:46:28.479668 bus /gobi_1: Setting Powered False 00:46:29.579520 bus /gobi_1: Setting Powered False 00:46:30.695520 bus /gobi_0: Setting Powered False 00:46:31.794243 bus /gobi_0: Setting Powered False 00:46:32.914750 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:sysmo ping.py ---------------------------------------------- 00:46:34.020413 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:34.032287 tst gprs:sysmo: Using 1 x bts (candidates: 1) 00:46:34.069648 tst ping.py: using LAC 24814 00:46:34.190839 tst ping.py: using RAC 79 00:46:34.312921 tst ping.py: using CellId 24814 00:46:34.432474 tst ping.py: using BVCI 24815 00:46:34.542641 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:34.553228 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:34.563698 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:34.574465 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:34.585079 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:34.595469 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:34.606174 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:34.616671 tst gprs:sysmo: Using 1 x modem (candidates: 4) 00:46:34.735413 tst ping.py:19: start network... 00:46:34.955511 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:46:35.464373 run create_hlr_db(pid=3959): Launched 00:46:35.598273 bus /gobi_6: Setting Powered False 00:46:36.663461 run create_hlr_db(pid=3959): Terminated: ok {rc=0} 00:46:37.100282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3961): Launched 00:46:37.408277 run osmo-hlr_10.42.42.2(pid=3962): Launched 00:46:37.525927 run osmo-stp_10.42.42.5: Starting osmo-stp 00:46:38.054491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3964): Launched 00:46:38.360826 run osmo-stp_10.42.42.5(pid=3965): Launched 00:46:38.477977 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:46:39.003695 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3967): Launched 00:46:39.121377 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:46:39.379450 run patchelf(pid=3968): Launched 00:46:39.550030 run osmo-stp_10.42.42.5(pid=3965): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3965)] 00:46:39.678727 run osmo-stp_10.42.42.5(pid=3965): stdout: | (launched: 2022-12-10_00:46:38.303396) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:46:39.809207 run osmo-stp_10.42.42.5(pid=3965): stderr: | 20221210004638476 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004638476 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004638476 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004638477 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004638477 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004638477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004638477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:46:39.939578 run osmo-stp_10.42.42.5(pid=3965): stdout: | (launched: 2022-12-10_00:46:38.303396) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:46:40.064784 run osmo-stp_10.42.42.5(pid=3965): stderr: | 20221210004638476 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004638476 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004638476 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004638477 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004638477 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004638477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004638477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:46:40.213366 run patchelf(pid=3968): Terminating (SIGINT) 00:46:40.383113 run patchelf(pid=3968): Terminated: ok {rc=0} 00:46:40.505068 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3965): Process ended prematurely: osmo-stp_10.42.42.5(pid=3965) [trial-2367↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3965)] [trial-2367↪gprs:sysmo↪ping.py:22] 00:46:40.513888 tst ping.py:22: Test FAILED (6.5 sec) 00:46:40.541105 run osmo-hlr_10.42.42.2(pid=3962): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3962)] 00:46:40.589895 run osmo-hlr_10.42.42.2(pid=3962): stdout: | (launched: 2022-12-10_00:46:37.350434) 00:46:40.640360 run osmo-hlr_10.42.42.2(pid=3962): stderr: | 20221210004637527 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004637527 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004637527 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004637527 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004637527 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004637527 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004637540 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004637552 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004637552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004637552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:46:40.691098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3961): Terminating (SIGTERM) 00:46:40.731907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3964): Terminating (SIGTERM) 00:46:40.773021 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3967): Terminating (SIGTERM) 00:46:40.814620 --- ParallelTerminationStrategy: PID 3961 died... 00:46:40.834156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3961): Terminated: ok {rc=0} 00:46:40.879596 --- ParallelTerminationStrategy: PID 3964 died... 00:46:40.898653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3964): Terminated: ok {rc=0} 00:46:40.943795 --- ParallelTerminationStrategy: PID 3967 died... 00:46:40.962811 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3967): Terminated: ok {rc=0} 00:46:41.050880 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 00:46:42.142846 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:42.154759 tst gprs:sysmo: Using 1 x bts (candidates: 1) 00:46:42.193070 tst ping_idle_ping.py: using LAC 24815 00:46:42.322381 tst ping_idle_ping.py: using RAC 80 00:46:42.451768 tst ping_idle_ping.py: using CellId 24815 00:46:42.581262 tst ping_idle_ping.py: using BVCI 24816 00:46:42.703065 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:42.714124 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:42.725133 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:42.736528 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:42.747883 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:42.759198 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:42.770765 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:42.782189 tst gprs:sysmo: Using 1 x modem (candidates: 4) 00:46:42.910963 tst ping_idle_ping.py:24: start network... 00:46:43.131513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:46:43.639938 run create_hlr_db(pid=3969): Launched 00:46:43.774934 bus /gobi_6: Setting Powered False 00:46:44.839662 run create_hlr_db(pid=3969): Terminated: ok {rc=0} 00:46:45.277090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3971): Launched 00:46:45.585583 run osmo-hlr_10.42.42.2(pid=3972): Launched 00:46:45.704309 run osmo-stp_10.42.42.5: Starting osmo-stp 00:46:46.276372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3974): Launched 00:46:46.629199 run osmo-stp_10.42.42.5(pid=3975): Launched 00:46:46.875411 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:46:47.537939 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3977): Launched 00:46:47.659215 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:46:47.919742 run patchelf(pid=3978): Launched 00:46:48.090745 run osmo-stp_10.42.42.5(pid=3975): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3975)] 00:46:48.219777 run osmo-stp_10.42.42.5(pid=3975): stdout: | (launched: 2022-12-10_00:46:46.570605) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:46:48.350927 run osmo-stp_10.42.42.5(pid=3975): stderr: | 20221210004646851 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004646851 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004646852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004646852 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004646852 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004646861 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004646861 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:46:48.481664 run osmo-stp_10.42.42.5(pid=3975): stdout: | (launched: 2022-12-10_00:46:46.570605) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:46:48.607364 run osmo-stp_10.42.42.5(pid=3975): stderr: | 20221210004646851 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004646851 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004646852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004646852 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004646852 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004646861 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004646861 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:46:48.756494 run patchelf(pid=3978): Terminating (SIGINT) 00:46:48.926900 run patchelf(pid=3978): Terminated: ok {rc=0} 00:46:49.049680 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3975): Process ended prematurely: osmo-stp_10.42.42.5(pid=3975) [trial-2367↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3975)] [trial-2367↪gprs:sysmo↪ping_idle_ping.py:27] 00:46:49.058585 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 00:46:49.086427 run osmo-hlr_10.42.42.2(pid=3972): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3972)] 00:46:49.135199 run osmo-hlr_10.42.42.2(pid=3972): stdout: | (launched: 2022-12-10_00:46:45.527880) 00:46:49.185887 run osmo-hlr_10.42.42.2(pid=3972): stderr: | 20221210004645706 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004645706 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004645706 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004645707 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004645707 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004645707 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004645718 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004645727 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004645727 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004645727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:46:49.236647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3971): Terminating (SIGTERM) 00:46:49.277004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3974): Terminating (SIGTERM) 00:46:49.317439 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3977): Terminating (SIGTERM) 00:46:49.357718 --- ParallelTerminationStrategy: PID 3971 died... 00:46:49.377387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3971): Terminated: ok {rc=0} 00:46:49.422475 --- ParallelTerminationStrategy: PID 3974 died... 00:46:49.441336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3974): Terminated: ok {rc=0} 00:46:49.486242 --- ParallelTerminationStrategy: PID 3977 died... 00:46:49.504875 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3977): Terminated: ok {rc=0} 00:46:49.591908 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 00:46:50.895773 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:46:50.902441 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 00:46:50.924215 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 00:46:50.962690 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 00:46:51.050868 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 00:46:51.073256 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 00:46:51.111680 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 00:46:51.700014 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 00:46:51.750542 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:46:51.761342 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:46:51.797699 tst cs_paging_gprs_active.py: using LAC 24816 00:46:51.927855 tst cs_paging_gprs_active.py: using RAC 81 00:46:52.057026 tst cs_paging_gprs_active.py: using CellId 24816 00:46:52.186545 tst cs_paging_gprs_active.py: using BVCI 24817 00:46:52.309653 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:46:52.321230 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:46:52.332499 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:46:52.343835 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:46:52.354776 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:46:52.365789 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:46:52.376910 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:46:52.388255 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:46:52.399649 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:46:52.521850 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:46:52.640108 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:46:52.849807 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:46:53.164238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3983): Launched 00:46:53.438688 run iperf3-srv_10.42.42.10(pid=3984): Launched 00:46:53.557423 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:46:53.765436 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:46:54.078728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3985): Launched 00:46:54.352464 run iperf3-srv_10.42.42.10(pid=3986): Launched 00:46:54.468621 tst cs_paging_gprs_active.py:38: start network... 00:46:54.677121 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:46:55.160433 run create_hlr_db(pid=3987): Launched 00:46:55.282316 bus /gobi_6: Setting Powered False 00:46:56.344089 run create_hlr_db(pid=3987): Terminated: ok {rc=0} 00:46:56.800055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3989): Launched 00:46:57.134246 run osmo-hlr_10.42.42.2(pid=3990): Launched 00:46:57.261606 run osmo-stp_10.42.42.5: Starting osmo-stp 00:46:57.839306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3992): Launched 00:46:58.172913 run osmo-stp_10.42.42.5(pid=3993): Launched 00:46:58.301697 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:46:58.877012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3995): Launched 00:46:59.005569 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:46:59.289084 run patchelf(pid=3996): Launched 00:46:59.474905 run osmo-stp_10.42.42.5(pid=3993): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3993)] 00:46:59.615060 run osmo-stp_10.42.42.5(pid=3993): stdout: | (launched: 2022-12-10_00:46:58.111026) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:46:59.756821 run osmo-stp_10.42.42.5(pid=3993): stderr: | 20221210004658304 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004658304 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004658305 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004658305 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004658305 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004658306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004658306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:46:59.898393 run osmo-stp_10.42.42.5(pid=3993): stdout: | (launched: 2022-12-10_00:46:58.111026) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:47:00.033914 run osmo-stp_10.42.42.5(pid=3993): stderr: | 20221210004658304 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004658304 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004658305 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004658305 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004658305 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004658306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004658306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:47:00.194760 run patchelf(pid=3996): Terminating (SIGINT) 00:47:00.379291 run patchelf(pid=3996): Terminated: ok {rc=0} 00:47:00.512410 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3993): Process ended prematurely: osmo-stp_10.42.42.5(pid=3993) [trial-2367↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3993)] [trial-2367↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 00:47:00.522756 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 00:47:00.551483 run osmo-hlr_10.42.42.2(pid=3990): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3990)] 00:47:00.602271 run osmo-hlr_10.42.42.2(pid=3990): stdout: | (launched: 2022-12-10_00:46:57.071745) 00:47:00.655223 run osmo-hlr_10.42.42.2(pid=3990): stderr: | 20221210004657275 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004657275 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004657275 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004657275 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004657275 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004657275 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004657289 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004657298 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004657299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004657299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:47:00.708099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3983): Terminating (SIGTERM) 00:47:00.750546 run iperf3-srv_10.42.42.10(pid=3984): Terminating (SIGTERM) 00:47:00.792841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3985): Terminating (SIGTERM) 00:47:00.853497 run iperf3-srv_10.42.42.10(pid=3986): Terminating (SIGTERM) 00:47:00.921819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3989): Terminating (SIGTERM) 00:47:00.965991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3992): Terminating (SIGTERM) 00:47:01.009648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3995): Terminating (SIGTERM) 00:47:01.074743 --- ParallelTerminationStrategy: PID 3983 died... 00:47:01.095333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3983): Terminated: ok {rc=0} 00:47:01.143582 --- ParallelTerminationStrategy: PID 3984 died... 00:47:01.163720 run iperf3-srv_10.42.42.10(pid=3984): Terminated {rc=256} 00:47:01.214763 --- ParallelTerminationStrategy: PID 3985 died... 00:47:01.234361 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3985): Terminated: ok {rc=0} 00:47:01.281732 --- ParallelTerminationStrategy: PID 3986 died... 00:47:01.301504 run iperf3-srv_10.42.42.10(pid=3986): Terminated {rc=256} 00:47:01.350289 --- ParallelTerminationStrategy: PID 3989 died... 00:47:01.369837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3989): Terminated: ok {rc=0} 00:47:01.417703 --- ParallelTerminationStrategy: PID 3992 died... 00:47:01.437410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3992): Terminated: ok {rc=0} 00:47:01.485157 --- ParallelTerminationStrategy: PID 3995 died... 00:47:01.504939 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3995): Terminated: ok {rc=0} 00:47:01.597181 bus /gobi_0: Setting Powered False 00:47:02.695857 bus /gobi_0: Setting Powered False 00:47:03.809527 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 00:47:04.961673 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:04.973837 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:47:05.012896 tst iperf3.py: using LAC 24817 00:47:05.143810 tst iperf3.py: using RAC 82 00:47:05.276381 tst iperf3.py: using CellId 24817 00:47:05.405925 tst iperf3.py: using BVCI 24818 00:47:05.526647 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:05.538002 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:05.549321 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:05.560403 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:05.571479 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:05.582567 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:05.593873 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:05.604930 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:05.616230 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:47:05.735209 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:47:05.943280 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:47:06.255439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3997): Launched 00:47:06.527395 run iperf3-srv_10.42.42.10(pid=3998): Launched 00:47:06.645661 tst iperf3.py:8: start network... 00:47:06.851732 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:47:07.332478 run create_hlr_db(pid=3999): Launched 00:47:07.451006 bus /gobi_6: Setting Powered False 00:47:08.511883 run create_hlr_db(pid=3999): Terminated: ok {rc=0} 00:47:08.942908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4001): Launched 00:47:09.255910 run osmo-hlr_10.42.42.2(pid=4002): Launched 00:47:09.375896 run osmo-stp_10.42.42.5: Starting osmo-stp 00:47:09.906872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4004): Launched 00:47:10.218743 run osmo-stp_10.42.42.5(pid=4005): Launched 00:47:10.339252 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:47:10.875288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4007): Launched 00:47:10.995133 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:47:11.258526 run patchelf(pid=4008): Launched 00:47:11.430074 run osmo-stp_10.42.42.5(pid=4005): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4005)] 00:47:11.560287 run osmo-stp_10.42.42.5(pid=4005): stdout: | (launched: 2022-12-10_00:47:10.160444) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:47:11.692083 run osmo-stp_10.42.42.5(pid=4005): stderr: | 20221210004710333 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004710333 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004710333 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004710334 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004710334 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004710334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004710334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:47:11.824729 run osmo-stp_10.42.42.5(pid=4005): stdout: | (launched: 2022-12-10_00:47:10.160444) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:47:11.951848 run osmo-stp_10.42.42.5(pid=4005): stderr: | 20221210004710333 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004710333 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004710333 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004710334 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004710334 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004710334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004710334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:47:12.101783 run patchelf(pid=4008): Terminating (SIGINT) 00:47:12.274040 run patchelf(pid=4008): Terminated: ok {rc=0} 00:47:12.398262 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4005): Process ended prematurely: osmo-stp_10.42.42.5(pid=4005) [trial-2367↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4005)] [trial-2367↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 00:47:12.407753 tst iperf3.py:8: Test FAILED (7.5 sec) 00:47:12.435490 run osmo-hlr_10.42.42.2(pid=4002): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4002)] 00:47:12.484083 run osmo-hlr_10.42.42.2(pid=4002): stdout: | (launched: 2022-12-10_00:47:09.196913) 00:47:12.533659 run osmo-hlr_10.42.42.2(pid=4002): stderr: | 20221210004709380 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004709380 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004709380 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004709380 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004709380 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004709380 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004709414 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004709424 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004709425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004709425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:47:12.583718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3997): Terminating (SIGTERM) 00:47:12.623643 run iperf3-srv_10.42.42.10(pid=3998): Terminating (SIGTERM) 00:47:12.663396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4001): Terminating (SIGTERM) 00:47:12.703224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4004): Terminating (SIGTERM) 00:47:12.742987 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4007): Terminating (SIGTERM) 00:47:12.783042 --- ParallelTerminationStrategy: PID 3997 died... 00:47:12.802189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3997): Terminated: ok {rc=0} 00:47:12.847023 --- ParallelTerminationStrategy: PID 3998 died... 00:47:12.865733 run iperf3-srv_10.42.42.10(pid=3998): Terminated {rc=256} 00:47:12.909969 --- ParallelTerminationStrategy: PID 4001 died... 00:47:12.928555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4001): Terminated: ok {rc=0} 00:47:12.972766 --- ParallelTerminationStrategy: PID 4004 died... 00:47:12.991416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4004): Terminated: ok {rc=0} 00:47:13.035977 --- ParallelTerminationStrategy: PID 4007 died... 00:47:13.054743 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4007): Terminated: ok {rc=0} 00:47:13.141887 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 00:47:14.292026 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:14.303587 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:47:14.342734 tst iperf3m4.py: using LAC 24818 00:47:14.476078 tst iperf3m4.py: using RAC 83 00:47:14.608586 tst iperf3m4.py: using CellId 24818 00:47:14.740136 tst iperf3m4.py: using BVCI 24819 00:47:14.862564 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:14.873970 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:14.885278 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:14.897117 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:14.908776 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:14.920375 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:14.932210 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:14.943755 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:14.955418 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:47:15.076862 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:47:15.197463 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:47:15.318357 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:47:15.439257 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:47:15.648550 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:47:15.970692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4010): Launched 00:47:16.262908 run iperf3-srv_10.42.42.10(pid=4011): Launched 00:47:16.386006 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:47:16.598597 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:47:16.921462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4012): Launched 00:47:17.241144 run iperf3-srv_10.42.42.10(pid=4013): Launched 00:47:17.374713 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:47:17.582962 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:47:17.896060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4014): Launched 00:47:18.169743 run iperf3-srv_10.42.42.10(pid=4015): Launched 00:47:18.286573 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:47:18.495049 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:47:18.809597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4016): Launched 00:47:19.082391 run iperf3-srv_10.42.42.10(pid=4017): Launched 00:47:19.198853 tst iperf3m4.py:8: start network... 00:47:19.406584 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:47:19.888879 run create_hlr_db(pid=4018): Launched 00:47:20.006336 bus /gobi_6: Setting Powered False 00:47:21.070630 run create_hlr_db(pid=4018): Terminated: ok {rc=0} 00:47:21.533428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4020): Launched 00:47:21.870786 run osmo-hlr_10.42.42.2(pid=4021): Launched 00:47:21.997908 run osmo-stp_10.42.42.5: Starting osmo-stp 00:47:22.574865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4023): Launched 00:47:22.909874 run osmo-stp_10.42.42.5(pid=4024): Launched 00:47:23.036769 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:47:23.611337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4026): Launched 00:47:23.738248 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:47:24.019710 run patchelf(pid=4027): Launched 00:47:24.203733 run osmo-stp_10.42.42.5(pid=4024): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4024)] 00:47:24.343686 run osmo-stp_10.42.42.5(pid=4024): stdout: | (launched: 2022-12-10_00:47:22.847406) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:47:24.484665 run osmo-stp_10.42.42.5(pid=4024): stderr: | 20221210004723043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004723043 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004723043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004723044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004723044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004723044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004723044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:47:24.626004 run osmo-stp_10.42.42.5(pid=4024): stdout: | (launched: 2022-12-10_00:47:22.847406) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:47:24.762355 run osmo-stp_10.42.42.5(pid=4024): stderr: | 20221210004723043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004723043 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004723043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004723044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004723044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004723044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004723044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:47:24.923082 run patchelf(pid=4027): Terminating (SIGINT) 00:47:25.107764 run patchelf(pid=4027): Terminated: ok {rc=0} 00:47:25.240491 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4024): Process ended prematurely: osmo-stp_10.42.42.5(pid=4024) [trial-2367↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4024)] [trial-2367↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 00:47:25.250706 tst iperf3m4.py:8: Test FAILED (11.0 sec) 00:47:25.279542 run osmo-hlr_10.42.42.2(pid=4021): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4021)] 00:47:25.330274 run osmo-hlr_10.42.42.2(pid=4021): stdout: | (launched: 2022-12-10_00:47:21.808422) 00:47:25.383022 run osmo-hlr_10.42.42.2(pid=4021): stderr: | 20221210004722013 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004722013 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004722013 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004722013 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004722013 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004722013 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004722026 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004722034 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004722034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004722034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:47:25.436065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4010): Terminating (SIGTERM) 00:47:25.478426 run iperf3-srv_10.42.42.10(pid=4011): Terminating (SIGTERM) 00:47:25.520466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4012): Terminating (SIGTERM) 00:47:25.562779 run iperf3-srv_10.42.42.10(pid=4013): Terminating (SIGTERM) 00:47:25.604749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4014): Terminating (SIGTERM) 00:47:25.646977 run iperf3-srv_10.42.42.10(pid=4015): Terminating (SIGTERM) 00:47:25.689293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4016): Terminating (SIGTERM) 00:47:25.731636 run iperf3-srv_10.42.42.10(pid=4017): Terminating (SIGTERM) 00:47:25.773613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4020): Terminating (SIGTERM) 00:47:25.815768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4023): Terminating (SIGTERM) 00:47:25.858005 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4026): Terminating (SIGTERM) 00:47:25.900436 --- ParallelTerminationStrategy: PID 4010 died... 00:47:25.920496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4010): Terminated: ok {rc=0} 00:47:25.967141 --- ParallelTerminationStrategy: PID 4011 died... 00:47:25.986749 run iperf3-srv_10.42.42.10(pid=4011): Terminated {rc=256} 00:47:26.033074 --- ParallelTerminationStrategy: PID 4012 died... 00:47:26.052824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4012): Terminated: ok {rc=0} 00:47:26.098984 --- ParallelTerminationStrategy: PID 4013 died... 00:47:26.118530 run iperf3-srv_10.42.42.10(pid=4013): Terminated {rc=256} 00:47:26.164675 --- ParallelTerminationStrategy: PID 4014 died... 00:47:26.184337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4014): Terminated: ok {rc=0} 00:47:26.230520 --- ParallelTerminationStrategy: PID 4015 died... 00:47:26.250211 run iperf3-srv_10.42.42.10(pid=4015): Terminated {rc=256} 00:47:26.296287 --- ParallelTerminationStrategy: PID 4016 died... 00:47:26.315997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4016): Terminated: ok {rc=0} 00:47:26.362307 --- ParallelTerminationStrategy: PID 4017 died... 00:47:26.381916 run iperf3-srv_10.42.42.10(pid=4017): Terminated {rc=256} 00:47:26.427989 --- ParallelTerminationStrategy: PID 4020 died... 00:47:26.447712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4020): Terminated: ok {rc=0} 00:47:26.493992 --- ParallelTerminationStrategy: PID 4023 died... 00:47:26.513654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4023): Terminated: ok {rc=0} 00:47:26.559879 --- ParallelTerminationStrategy: PID 4026 died... 00:47:26.579610 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4026): Terminated: ok {rc=0} 00:47:26.667977 bus /gobi_4: Setting Powered False 00:47:27.769649 bus /gobi_4: Setting Powered False 00:47:28.887513 bus /gobi_1: Setting Powered False 00:47:29.986715 bus /gobi_1: Setting Powered False 00:47:31.101816 bus /gobi_0: Setting Powered False 00:47:32.202402 bus /gobi_0: Setting Powered False 00:47:33.319845 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 00:47:34.424437 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:34.436186 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:47:34.476044 tst ping.py: using LAC 24819 00:47:34.605607 tst ping.py: using RAC 84 00:47:34.735820 tst ping.py: using CellId 24819 00:47:34.864681 tst ping.py: using BVCI 24820 00:47:34.983640 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:34.994959 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:35.006208 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:35.017421 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:35.028399 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:35.039456 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:35.050728 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:35.061945 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:47:35.181018 tst ping.py:19: start network... 00:47:35.385415 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:47:35.860094 run create_hlr_db(pid=4028): Launched 00:47:35.985454 bus /gobi_6: Setting Powered False 00:47:37.046078 run create_hlr_db(pid=4028): Terminated: ok {rc=0} 00:47:37.494574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4032): Launched 00:47:37.823899 run osmo-hlr_10.42.42.2(pid=4033): Launched 00:47:37.949894 run osmo-stp_10.42.42.5: Starting osmo-stp 00:47:38.517455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4035): Launched 00:47:38.848031 run osmo-stp_10.42.42.5(pid=4036): Launched 00:47:38.973671 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:47:39.538154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4038): Launched 00:47:39.663900 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:47:39.941136 run patchelf(pid=4039): Launched 00:47:40.124019 run osmo-stp_10.42.42.5(pid=4036): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4036)] 00:47:40.260878 run osmo-stp_10.42.42.5(pid=4036): stdout: | (launched: 2022-12-10_00:47:38.786280) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:47:40.399221 run osmo-stp_10.42.42.5(pid=4036): stderr: | 20221210004738980 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004738980 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004738981 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004738981 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004738983 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004738984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004738984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:47:40.538192 run osmo-stp_10.42.42.5(pid=4036): stdout: | (launched: 2022-12-10_00:47:38.786280) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:47:40.671920 run osmo-stp_10.42.42.5(pid=4036): stderr: | 20221210004738980 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004738980 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004738981 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004738981 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004738983 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004738984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004738984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:47:40.830650 run patchelf(pid=4039): Terminating (SIGINT) 00:47:41.011447 run patchelf(pid=4039): Terminated: ok {rc=0} 00:47:41.141512 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4036): Process ended prematurely: osmo-stp_10.42.42.5(pid=4036) [trial-2367↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4036)] [trial-2367↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 00:47:41.151084 tst ping.py:22: Test FAILED (6.7 sec) 00:47:41.179215 run osmo-hlr_10.42.42.2(pid=4033): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4033)] 00:47:41.229450 run osmo-hlr_10.42.42.2(pid=4033): stdout: | (launched: 2022-12-10_00:47:37.762635) 00:47:41.281352 run osmo-hlr_10.42.42.2(pid=4033): stderr: | 20221210004737965 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004737965 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004737965 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004737965 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004737965 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004737965 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004737978 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004737986 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004737987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004737987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:47:41.333788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4032): Terminating (SIGTERM) 00:47:41.375796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4035): Terminating (SIGTERM) 00:47:41.418108 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4038): Terminating (SIGTERM) 00:47:41.461180 --- ParallelTerminationStrategy: PID 4032 died... 00:47:41.481786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4032): Terminated: ok {rc=0} 00:47:41.529473 --- ParallelTerminationStrategy: PID 4035 died... 00:47:41.549385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4035): Terminated: ok {rc=0} 00:47:41.596573 --- ParallelTerminationStrategy: PID 4038 died... 00:47:41.616653 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4038): Terminated: ok {rc=0} 00:47:41.705637 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 00:47:42.795558 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:42.807581 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:47:42.846844 tst ping_idle_ping.py: using LAC 24820 00:47:42.977077 tst ping_idle_ping.py: using RAC 85 00:47:43.106263 tst ping_idle_ping.py: using CellId 24820 00:47:43.235150 tst ping_idle_ping.py: using BVCI 24821 00:47:43.355806 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:43.367162 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:43.378490 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:43.389671 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:43.400681 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:43.411828 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:43.423143 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:43.434327 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:47:43.559571 tst ping_idle_ping.py:24: start network... 00:47:43.765186 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:47:44.239821 run create_hlr_db(pid=4040): Launched 00:47:44.359594 bus /gobi_6: Setting Powered False 00:47:45.420302 run create_hlr_db(pid=4040): Terminated: ok {rc=0} 00:47:45.877710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4042): Launched 00:47:46.214907 run osmo-hlr_10.42.42.2(pid=4043): Launched 00:47:46.464406 run osmo-stp_10.42.42.5: Starting osmo-stp 00:47:47.277732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4045): Launched 00:47:47.601682 run osmo-stp_10.42.42.5(pid=4046): Launched 00:47:47.722114 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:47:48.253418 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4048): Launched 00:47:48.370838 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:47:48.630958 run patchelf(pid=4049): Launched 00:47:48.801819 run osmo-stp_10.42.42.5(pid=4046): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4046)] 00:47:48.930995 run osmo-stp_10.42.42.5(pid=4046): stdout: | (launched: 2022-12-10_00:47:47.543589) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:47:49.061300 run osmo-stp_10.42.42.5(pid=4046): stderr: | 20221210004747715 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004747715 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004747715 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004747716 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004747716 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004747716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004747716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:47:49.192555 run osmo-stp_10.42.42.5(pid=4046): stdout: | (launched: 2022-12-10_00:47:47.543589) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:47:49.318354 run osmo-stp_10.42.42.5(pid=4046): stderr: | 20221210004747715 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004747715 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004747715 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004747716 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004747716 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004747716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004747716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:47:49.467230 run patchelf(pid=4049): Terminating (SIGINT) 00:47:49.637809 run patchelf(pid=4049): Terminated: ok {rc=0} 00:47:49.760307 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4046): Process ended prematurely: osmo-stp_10.42.42.5(pid=4046) [trial-2367↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4046)] [trial-2367↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 00:47:49.769447 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 00:47:49.796536 run osmo-hlr_10.42.42.2(pid=4043): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4043)] 00:47:49.844537 run osmo-hlr_10.42.42.2(pid=4043): stdout: | (launched: 2022-12-10_00:47:46.156651) 00:47:49.894243 run osmo-hlr_10.42.42.2(pid=4043): stderr: | 20221210004746382 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004746382 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004746382 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004746382 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004746382 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004746382 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004746398 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004746420 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004746420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004746420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:47:49.944603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4042): Terminating (SIGTERM) 00:47:49.984706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4045): Terminating (SIGTERM) 00:47:50.024698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4048): Terminating (SIGTERM) 00:47:50.064777 --- ParallelTerminationStrategy: PID 4042 died... 00:47:50.083806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4042): Terminated: ok {rc=0} 00:47:50.128300 --- ParallelTerminationStrategy: PID 4045 died... 00:47:50.146906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4045): Terminated: ok {rc=0} 00:47:50.191702 --- ParallelTerminationStrategy: PID 4048 died... 00:47:50.210673 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4048): Terminated: ok {rc=0} 00:47:50.295567 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 00:47:51.589275 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:47:51.595901 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 00:47:51.617994 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 00:47:51.657353 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 00:47:51.748133 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 00:47:51.769768 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 00:47:51.810234 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 00:47:52.405750 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 00:47:52.459596 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:47:52.471073 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:47:52.529481 tst cs_paging_gprs_active.py: using LAC 24821 00:47:52.660247 tst cs_paging_gprs_active.py: using RAC 86 00:47:52.793556 tst cs_paging_gprs_active.py: using CellId 24821 00:47:52.925172 tst cs_paging_gprs_active.py: using BVCI 24822 00:47:53.048244 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:47:53.059594 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:47:53.070806 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:47:53.082490 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:47:53.094217 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:47:53.105883 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:47:53.117633 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:47:53.129510 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:47:53.141501 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:47:53.260700 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:47:53.383141 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:47:53.609733 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:47:53.945658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4053): Launched 00:47:54.239433 run iperf3-srv_10.42.42.10(pid=4054): Launched 00:47:54.364092 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:47:54.588445 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:47:54.924187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4055): Launched 00:47:55.214625 run iperf3-srv_10.42.42.10(pid=4056): Launched 00:47:55.339721 tst cs_paging_gprs_active.py:38: start network... 00:47:55.564144 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:47:56.083536 run create_hlr_db(pid=4057): Launched 00:47:56.219768 bus /gobi_6: Setting Powered False 00:47:57.285186 run create_hlr_db(pid=4057): Terminated: ok {rc=0} 00:47:57.750449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4059): Launched 00:47:58.087034 run osmo-hlr_10.42.42.2(pid=4060): Launched 00:47:58.213786 run osmo-stp_10.42.42.5: Starting osmo-stp 00:47:58.788389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4062): Launched 00:47:59.121369 run osmo-stp_10.42.42.5(pid=4063): Launched 00:47:59.250173 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:47:59.830117 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4065): Launched 00:47:59.958152 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:48:00.240482 run patchelf(pid=4066): Launched 00:48:00.426331 run osmo-stp_10.42.42.5(pid=4063): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4063)] 00:48:00.566331 run osmo-stp_10.42.42.5(pid=4063): stdout: | (launched: 2022-12-10_00:47:59.059314) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:48:00.708378 run osmo-stp_10.42.42.5(pid=4063): stderr: | 20221210004759253 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004759253 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004759253 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004759254 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004759256 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004759256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004759256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:48:00.859678 run osmo-stp_10.42.42.5(pid=4063): stdout: | (launched: 2022-12-10_00:47:59.059314) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:48:00.992258 run osmo-stp_10.42.42.5(pid=4063): stderr: | 20221210004759253 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004759253 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004759253 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004759254 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004759256 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004759256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004759256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:48:01.151884 run patchelf(pid=4066): Terminating (SIGINT) 00:48:01.328232 run patchelf(pid=4066): Terminated: ok {rc=0} 00:48:01.467753 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4063): Process ended prematurely: osmo-stp_10.42.42.5(pid=4063) [trial-2367↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4063)] [trial-2367↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 00:48:01.478302 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 00:48:01.507338 run osmo-hlr_10.42.42.2(pid=4060): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4060)] 00:48:01.557998 run osmo-hlr_10.42.42.2(pid=4060): stdout: | (launched: 2022-12-10_00:47:58.024592) 00:48:01.610274 run osmo-hlr_10.42.42.2(pid=4060): stderr: | 20221210004758227 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004758227 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004758227 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004758227 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004758227 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004758227 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004758240 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004758250 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004758250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004758250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:48:01.663809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4053): Terminating (SIGTERM) 00:48:01.706649 run iperf3-srv_10.42.42.10(pid=4054): Terminating (SIGTERM) 00:48:01.748868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4055): Terminating (SIGTERM) 00:48:01.791214 run iperf3-srv_10.42.42.10(pid=4056): Terminating (SIGTERM) 00:48:01.833615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4059): Terminating (SIGTERM) 00:48:01.876576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4062): Terminating (SIGTERM) 00:48:01.920552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4065): Terminating (SIGTERM) 00:48:01.963248 --- ParallelTerminationStrategy: PID 4053 died... 00:48:01.983210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4053): Terminated: ok {rc=0} 00:48:02.029990 --- ParallelTerminationStrategy: PID 4054 died... 00:48:02.049945 run iperf3-srv_10.42.42.10(pid=4054): Terminated {rc=256} 00:48:02.096211 --- ParallelTerminationStrategy: PID 4055 died... 00:48:02.116127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4055): Terminated: ok {rc=0} 00:48:02.162224 --- ParallelTerminationStrategy: PID 4056 died... 00:48:02.181747 run iperf3-srv_10.42.42.10(pid=4056): Terminated {rc=256} 00:48:02.227595 --- ParallelTerminationStrategy: PID 4059 died... 00:48:02.247402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4059): Terminated: ok {rc=0} 00:48:02.293335 --- ParallelTerminationStrategy: PID 4062 died... 00:48:02.312591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4062): Terminated: ok {rc=0} 00:48:02.358251 --- ParallelTerminationStrategy: PID 4065 died... 00:48:02.377515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4065): Terminated: ok {rc=0} 00:48:02.464064 bus /gobi_0: Setting Powered False 00:48:03.560929 bus /gobi_0: Setting Powered False 00:48:04.676012 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 00:48:05.825292 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:05.837136 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:48:05.897532 tst iperf3.py: using LAC 24822 00:48:06.030019 tst iperf3.py: using RAC 87 00:48:06.155499 tst iperf3.py: using CellId 24822 00:48:06.280148 tst iperf3.py: using BVCI 24823 00:48:06.399480 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:06.410772 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:06.421803 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:06.432826 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:06.443783 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:06.454727 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:06.465899 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:06.476740 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:06.487893 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:48:06.605164 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:48:06.823739 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:48:07.148654 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4067): Launched 00:48:07.431199 run iperf3-srv_10.42.42.10(pid=4068): Launched 00:48:07.552793 tst iperf3.py:8: start network... 00:48:07.771702 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:48:08.273469 run create_hlr_db(pid=4069): Launched 00:48:08.396923 bus /gobi_6: Setting Powered False 00:48:09.457349 run create_hlr_db(pid=4069): Terminated: ok {rc=0} 00:48:09.876386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4071): Launched 00:48:10.176684 run osmo-hlr_10.42.42.2(pid=4072): Launched 00:48:10.289943 run osmo-stp_10.42.42.5: Starting osmo-stp 00:48:10.806171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4074): Launched 00:48:11.107263 run osmo-stp_10.42.42.5(pid=4075): Launched 00:48:11.222191 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:48:11.740656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4077): Launched 00:48:11.855531 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:48:12.110349 run patchelf(pid=4078): Launched 00:48:12.276525 run osmo-stp_10.42.42.5(pid=4075): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4075)] 00:48:12.402904 run osmo-stp_10.42.42.5(pid=4075): stdout: | (launched: 2022-12-10_00:48:11.050423) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:48:12.530944 run osmo-stp_10.42.42.5(pid=4075): stderr: | 20221210004811222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004811222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004811222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004811223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004811223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004811223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004811223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:48:12.659287 run osmo-stp_10.42.42.5(pid=4075): stdout: | (launched: 2022-12-10_00:48:11.050423) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:48:12.781892 run osmo-stp_10.42.42.5(pid=4075): stderr: | 20221210004811222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004811222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004811222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004811223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004811223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004811223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004811223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:48:12.927323 run patchelf(pid=4078): Terminating (SIGINT) 00:48:13.094630 run patchelf(pid=4078): Terminated: ok {rc=0} 00:48:13.215543 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4075): Process ended prematurely: osmo-stp_10.42.42.5(pid=4075) [trial-2367↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4075)] [trial-2367↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 00:48:13.224799 tst iperf3.py:8: Test FAILED (7.4 sec) 00:48:13.252055 run osmo-hlr_10.42.42.2(pid=4072): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4072)] 00:48:13.299358 run osmo-hlr_10.42.42.2(pid=4072): stdout: | (launched: 2022-12-10_00:48:10.120586) 00:48:13.348307 run osmo-hlr_10.42.42.2(pid=4072): stderr: | 20221210004810296 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004810297 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004810297 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004810297 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004810297 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004810297 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004810312 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004810322 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004810322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004810322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:48:13.397871 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4067): Terminating (SIGTERM) 00:48:13.437430 run iperf3-srv_10.42.42.10(pid=4068): Terminating (SIGTERM) 00:48:13.477064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4071): Terminating (SIGTERM) 00:48:13.516469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4074): Terminating (SIGTERM) 00:48:13.555894 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4077): Terminating (SIGTERM) 00:48:13.595617 --- ParallelTerminationStrategy: PID 4067 died... 00:48:13.614452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4067): Terminated: ok {rc=0} 00:48:13.658854 --- ParallelTerminationStrategy: PID 4068 died... 00:48:13.677294 run iperf3-srv_10.42.42.10(pid=4068): Terminated {rc=256} 00:48:13.721276 --- ParallelTerminationStrategy: PID 4071 died... 00:48:13.739942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4071): Terminated: ok {rc=0} 00:48:13.784165 --- ParallelTerminationStrategy: PID 4074 died... 00:48:13.802705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4074): Terminated: ok {rc=0} 00:48:13.846959 --- ParallelTerminationStrategy: PID 4077 died... 00:48:13.865600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4077): Terminated: ok {rc=0} 00:48:13.949487 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 00:48:15.098153 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:15.110073 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:48:15.169834 tst iperf3m4.py: using LAC 24823 00:48:15.297731 tst iperf3m4.py: using RAC 88 00:48:15.425060 tst iperf3m4.py: using CellId 24823 00:48:15.551502 tst iperf3m4.py: using BVCI 24824 00:48:15.669873 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:15.681234 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:15.692610 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:15.704340 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:15.716184 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:15.727795 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:15.739847 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:15.751466 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:15.763527 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:48:15.887981 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:48:16.014913 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:48:16.140821 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:48:16.267397 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:48:16.481701 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:48:16.803940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4079): Launched 00:48:17.094762 run iperf3-srv_10.42.42.10(pid=4080): Launched 00:48:17.227596 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:48:17.432487 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:48:17.737031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4081): Launched 00:48:17.999809 run iperf3-srv_10.42.42.10(pid=4082): Launched 00:48:18.112387 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:48:18.312910 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:48:18.614928 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4083): Launched 00:48:18.877591 run iperf3-srv_10.42.42.10(pid=4084): Launched 00:48:18.990505 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:48:19.191497 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:48:19.495338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4085): Launched 00:48:19.759658 run iperf3-srv_10.42.42.10(pid=4086): Launched 00:48:19.872530 tst iperf3m4.py:8: start network... 00:48:20.072783 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:48:20.540011 run create_hlr_db(pid=4087): Launched 00:48:20.655601 bus /gobi_6: Setting Powered False 00:48:21.715730 run create_hlr_db(pid=4087): Terminated: ok {rc=0} 00:48:22.135739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4089): Launched 00:48:22.436790 run osmo-hlr_10.42.42.2(pid=4090): Launched 00:48:22.551561 run osmo-stp_10.42.42.5: Starting osmo-stp 00:48:23.071812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4092): Launched 00:48:23.372283 run osmo-stp_10.42.42.5(pid=4093): Launched 00:48:23.487715 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:48:24.006742 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4095): Launched 00:48:24.120731 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:48:24.375468 run patchelf(pid=4096): Launched 00:48:24.542022 run osmo-stp_10.42.42.5(pid=4093): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4093)] 00:48:24.668544 run osmo-stp_10.42.42.5(pid=4093): stdout: | (launched: 2022-12-10_00:48:23.315230) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:48:24.796804 run osmo-stp_10.42.42.5(pid=4093): stderr: | 20221210004823485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004823485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004823485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004823486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004823488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004823488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004823488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:48:24.925101 run osmo-stp_10.42.42.5(pid=4093): stdout: | (launched: 2022-12-10_00:48:23.315230) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:48:25.048143 run osmo-stp_10.42.42.5(pid=4093): stderr: | 20221210004823485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004823485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004823485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004823486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004823488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004823488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004823488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:48:25.193745 run patchelf(pid=4096): Terminating (SIGINT) 00:48:25.360939 run patchelf(pid=4096): Terminated: ok {rc=0} 00:48:25.482064 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4093): Process ended prematurely: osmo-stp_10.42.42.5(pid=4093) [trial-2367↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4093)] [trial-2367↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 00:48:25.491301 tst iperf3m4.py:8: Test FAILED (10.4 sec) 00:48:25.518886 run osmo-hlr_10.42.42.2(pid=4090): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4090)] 00:48:25.566136 run osmo-hlr_10.42.42.2(pid=4090): stdout: | (launched: 2022-12-10_00:48:22.379870) 00:48:25.615320 run osmo-hlr_10.42.42.2(pid=4090): stderr: | 20221210004822558 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004822558 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004822558 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004822558 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004822558 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004822558 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004822570 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004822578 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004822579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004822579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:48:25.665350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4079): Terminating (SIGTERM) 00:48:25.704873 run iperf3-srv_10.42.42.10(pid=4080): Terminating (SIGTERM) 00:48:25.744537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4081): Terminating (SIGTERM) 00:48:25.784151 run iperf3-srv_10.42.42.10(pid=4082): Terminating (SIGTERM) 00:48:25.823808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4083): Terminating (SIGTERM) 00:48:25.863844 run iperf3-srv_10.42.42.10(pid=4084): Terminating (SIGTERM) 00:48:25.903259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4085): Terminating (SIGTERM) 00:48:25.942830 run iperf3-srv_10.42.42.10(pid=4086): Terminating (SIGTERM) 00:48:25.981966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4089): Terminating (SIGTERM) 00:48:26.021752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4092): Terminating (SIGTERM) 00:48:26.061224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4095): Terminating (SIGTERM) 00:48:26.101567 --- ParallelTerminationStrategy: PID 4079 died... 00:48:26.120550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4079): Terminated: ok {rc=0} 00:48:26.164729 --- ParallelTerminationStrategy: PID 4080 died... 00:48:26.183211 run iperf3-srv_10.42.42.10(pid=4080): Terminated {rc=256} 00:48:26.227069 --- ParallelTerminationStrategy: PID 4081 died... 00:48:26.245518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4081): Terminated: ok {rc=0} 00:48:26.289283 --- ParallelTerminationStrategy: PID 4082 died... 00:48:26.307582 run iperf3-srv_10.42.42.10(pid=4082): Terminated {rc=256} 00:48:26.351282 --- ParallelTerminationStrategy: PID 4083 died... 00:48:26.369598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4083): Terminated: ok {rc=0} 00:48:26.413336 --- ParallelTerminationStrategy: PID 4084 died... 00:48:26.431635 run iperf3-srv_10.42.42.10(pid=4084): Terminated {rc=256} 00:48:26.475197 --- ParallelTerminationStrategy: PID 4085 died... 00:48:26.493610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4085): Terminated: ok {rc=0} 00:48:26.537306 --- ParallelTerminationStrategy: PID 4086 died... 00:48:26.556119 run iperf3-srv_10.42.42.10(pid=4086): Terminated {rc=256} 00:48:26.599758 --- ParallelTerminationStrategy: PID 4089 died... 00:48:26.618223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4089): Terminated: ok {rc=0} 00:48:26.662781 --- ParallelTerminationStrategy: PID 4092 died... 00:48:26.681576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4092): Terminated: ok {rc=0} 00:48:26.725549 --- ParallelTerminationStrategy: PID 4095 died... 00:48:26.743878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4095): Terminated: ok {rc=0} 00:48:26.831347 bus /gobi_4: Setting Powered False 00:48:27.932240 bus /gobi_4: Setting Powered False 00:48:29.048257 bus /gobi_1: Setting Powered False 00:48:30.147728 bus /gobi_1: Setting Powered False 00:48:31.278008 bus /gobi_0: Setting Powered False 00:48:32.377220 bus /gobi_0: Setting Powered False 00:48:33.492337 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 00:48:34.594434 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:34.605827 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:48:34.661905 tst ping.py: using LAC 24824 00:48:34.775574 tst ping.py: using RAC 89 00:48:34.888274 tst ping.py: using CellId 24824 00:48:35.013652 tst ping.py: using BVCI 24825 00:48:35.127854 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:35.139151 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:35.150419 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:35.162214 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:35.173959 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:35.185473 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:35.197320 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:35.208791 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:48:35.321197 tst ping.py:19: start network... 00:48:35.513228 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:48:35.962801 run create_hlr_db(pid=4097): Launched 00:48:36.072834 bus /gobi_6: Setting Powered False 00:48:37.130636 run create_hlr_db(pid=4097): Terminated: ok {rc=0} 00:48:37.537326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4099): Launched 00:48:37.829248 run osmo-hlr_10.42.42.2(pid=4100): Launched 00:48:37.939942 run osmo-stp_10.42.42.5: Starting osmo-stp 00:48:38.444652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4102): Launched 00:48:38.734542 run osmo-stp_10.42.42.5(pid=4103): Launched 00:48:38.843911 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:48:39.341533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4105): Launched 00:48:39.452231 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:48:39.699304 run patchelf(pid=4106): Launched 00:48:39.858567 run osmo-stp_10.42.42.5(pid=4103): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4103)] 00:48:39.980499 run osmo-stp_10.42.42.5(pid=4103): stdout: | (launched: 2022-12-10_00:48:38.678551) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:48:40.103589 run osmo-stp_10.42.42.5(pid=4103): stderr: | 20221210004838853 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004838853 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004838853 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004838853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004838854 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004838854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004838854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:48:40.226766 run osmo-stp_10.42.42.5(pid=4103): stdout: | (launched: 2022-12-10_00:48:38.678551) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:48:40.345136 run osmo-stp_10.42.42.5(pid=4103): stderr: | 20221210004838853 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004838853 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004838853 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004838853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004838854 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004838854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004838854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:48:40.484881 run patchelf(pid=4106): Terminating (SIGINT) 00:48:40.645483 run patchelf(pid=4106): Terminated: ok {rc=0} 00:48:40.761366 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4103): Process ended prematurely: osmo-stp_10.42.42.5(pid=4103) [trial-2367↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4103)] [trial-2367↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 00:48:40.769902 tst ping.py:22: Test FAILED (6.2 sec) 00:48:40.796380 run osmo-hlr_10.42.42.2(pid=4100): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4100)] 00:48:40.843205 run osmo-hlr_10.42.42.2(pid=4100): stdout: | (launched: 2022-12-10_00:48:37.772815) 00:48:40.891507 run osmo-hlr_10.42.42.2(pid=4100): stderr: | 20221210004837950 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004837950 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004837950 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004837950 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004837950 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004837950 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004837961 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004837970 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004837970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004837970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:48:40.940485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4099): Terminating (SIGTERM) 00:48:40.979232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4102): Terminating (SIGTERM) 00:48:41.018395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4105): Terminating (SIGTERM) 00:48:41.058044 --- ParallelTerminationStrategy: PID 4099 died... 00:48:41.076760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4099): Terminated: ok {rc=0} 00:48:41.120501 --- ParallelTerminationStrategy: PID 4102 died... 00:48:41.138752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4102): Terminated: ok {rc=0} 00:48:41.182118 --- ParallelTerminationStrategy: PID 4105 died... 00:48:41.200349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4105): Terminated: ok {rc=0} 00:48:41.282882 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 00:48:42.368360 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:42.380295 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:48:42.439585 tst ping_idle_ping.py: using LAC 24825 00:48:42.561438 tst ping_idle_ping.py: using RAC 90 00:48:42.683297 tst ping_idle_ping.py: using CellId 24825 00:48:42.806948 tst ping_idle_ping.py: using BVCI 24826 00:48:42.921737 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:42.932814 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:42.943797 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:42.955210 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:42.966599 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:42.977933 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:42.989449 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:43.000817 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:48:43.116093 tst ping_idle_ping.py:24: start network... 00:48:43.308918 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:48:43.763257 run create_hlr_db(pid=4107): Launched 00:48:43.874633 bus /gobi_6: Setting Powered False 00:48:44.932143 run create_hlr_db(pid=4107): Terminated: ok {rc=0} 00:48:45.360378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4109): Launched 00:48:45.676700 run osmo-hlr_10.42.42.2(pid=4110): Launched 00:48:45.795730 run osmo-stp_10.42.42.5: Starting osmo-stp 00:48:46.581624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4112): Launched 00:48:46.891744 run osmo-stp_10.42.42.5(pid=4113): Launched 00:48:47.095544 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:48:47.677118 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4115): Launched 00:48:47.788566 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:48:48.036453 run patchelf(pid=4116): Launched 00:48:48.197569 run osmo-stp_10.42.42.5(pid=4113): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4113)] 00:48:48.320152 run osmo-stp_10.42.42.5(pid=4113): stdout: | (launched: 2022-12-10_00:48:46.827687) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:48:48.444332 run osmo-stp_10.42.42.5(pid=4113): stderr: | 20221210004847160 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004847160 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004847160 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004847173 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004847176 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004847176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004847176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:48:48.568818 run osmo-stp_10.42.42.5(pid=4113): stdout: | (launched: 2022-12-10_00:48:46.827687) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:48:48.688009 run osmo-stp_10.42.42.5(pid=4113): stderr: | 20221210004847160 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004847160 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004847160 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004847173 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004847176 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004847176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004847176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:48:48.829299 run patchelf(pid=4116): Terminating (SIGINT) 00:48:48.991259 run patchelf(pid=4116): Terminated: ok {rc=0} 00:48:49.108068 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4113): Process ended prematurely: osmo-stp_10.42.42.5(pid=4113) [trial-2367↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4113)] [trial-2367↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 00:48:49.116778 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 00:48:49.143433 run osmo-hlr_10.42.42.2(pid=4110): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4110)] 00:48:49.190820 run osmo-hlr_10.42.42.2(pid=4110): stdout: | (launched: 2022-12-10_00:48:45.614747) 00:48:49.239501 run osmo-hlr_10.42.42.2(pid=4110): stderr: | 20221210004845814 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004845814 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004845814 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004845814 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004845814 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004845814 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004845837 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004845856 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004845856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004845857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:48:49.289347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4109): Terminating (SIGTERM) 00:48:49.328717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4112): Terminating (SIGTERM) 00:48:49.368311 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4115): Terminating (SIGTERM) 00:48:49.408283 --- ParallelTerminationStrategy: PID 4109 died... 00:48:49.427190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4109): Terminated: ok {rc=0} 00:48:49.471423 --- ParallelTerminationStrategy: PID 4112 died... 00:48:49.489935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4112): Terminated: ok {rc=0} 00:48:49.533668 --- ParallelTerminationStrategy: PID 4115 died... 00:48:49.552261 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4115): Terminated: ok {rc=0} 00:48:49.637490 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 00:48:50.923575 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:48:50.929768 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 00:48:50.950936 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 00:48:50.989120 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 00:48:51.077465 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 00:48:51.098364 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 00:48:51.135894 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 00:48:51.723373 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 00:48:51.771854 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:48:51.782682 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:48:51.837081 tst cs_paging_gprs_active.py: using LAC 24826 00:48:51.954226 tst cs_paging_gprs_active.py: using RAC 91 00:48:52.078891 tst cs_paging_gprs_active.py: using CellId 24826 00:48:52.202441 tst cs_paging_gprs_active.py: using BVCI 24827 00:48:52.318093 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:48:52.329434 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:48:52.340461 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:48:52.351845 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:48:52.362872 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:48:52.374039 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:48:52.385261 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:48:52.396081 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:48:52.407307 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:48:52.520702 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:48:52.638429 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:48:52.854627 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:48:53.173442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4121): Launched 00:48:53.451341 run iperf3-srv_10.42.42.10(pid=4122): Launched 00:48:53.570887 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:48:53.785520 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:48:54.104364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4123): Launched 00:48:54.380810 run iperf3-srv_10.42.42.10(pid=4124): Launched 00:48:54.500454 tst cs_paging_gprs_active.py:38: start network... 00:48:54.714960 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:48:55.209290 run create_hlr_db(pid=4125): Launched 00:48:55.339754 bus /gobi_6: Setting Powered False 00:48:56.402711 run create_hlr_db(pid=4125): Terminated: ok {rc=0} 00:48:56.826207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4127): Launched 00:48:57.123811 run osmo-hlr_10.42.42.2(pid=4128): Launched 00:48:57.238241 run osmo-stp_10.42.42.5: Starting osmo-stp 00:48:57.748888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4130): Launched 00:48:58.046046 run osmo-stp_10.42.42.5(pid=4131): Launched 00:48:58.160524 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:48:58.671725 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4133): Launched 00:48:58.787545 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:48:59.039381 run patchelf(pid=4134): Launched 00:48:59.205244 run osmo-stp_10.42.42.5(pid=4131): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4131)] 00:48:59.331178 run osmo-stp_10.42.42.5(pid=4131): stdout: | (launched: 2022-12-10_00:48:57.991865) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:48:59.458114 run osmo-stp_10.42.42.5(pid=4131): stderr: | 20221210004858162 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004858162 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004858162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004858163 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004858163 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004858163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004858163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:48:59.585614 run osmo-stp_10.42.42.5(pid=4131): stdout: | (launched: 2022-12-10_00:48:57.991865) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:48:59.707431 run osmo-stp_10.42.42.5(pid=4131): stderr: | 20221210004858162 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004858162 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004858162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004858163 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004858163 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004858163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004858163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:48:59.851466 run patchelf(pid=4134): Terminating (SIGINT) 00:49:00.017693 run patchelf(pid=4134): Terminated: ok {rc=0} 00:49:00.137874 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4131): Process ended prematurely: osmo-stp_10.42.42.5(pid=4131) [trial-2367↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4131)] [trial-2367↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 00:49:00.147141 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 00:49:00.174328 run osmo-hlr_10.42.42.2(pid=4128): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4128)] 00:49:00.221901 run osmo-hlr_10.42.42.2(pid=4128): stdout: | (launched: 2022-12-10_00:48:57.069566) 00:49:00.270802 run osmo-hlr_10.42.42.2(pid=4128): stderr: | 20221210004857245 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004857245 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004857245 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004857245 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004857245 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004857245 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004857257 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004857266 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004857266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004857266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:49:00.320334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4121): Terminating (SIGTERM) 00:49:00.359745 run iperf3-srv_10.42.42.10(pid=4122): Terminating (SIGTERM) 00:49:00.399133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4123): Terminating (SIGTERM) 00:49:00.438626 run iperf3-srv_10.42.42.10(pid=4124): Terminating (SIGTERM) 00:49:00.477883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4127): Terminating (SIGTERM) 00:49:00.517137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4130): Terminating (SIGTERM) 00:49:00.556334 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4133): Terminating (SIGTERM) 00:49:00.595994 --- ParallelTerminationStrategy: PID 4121 died... 00:49:00.614694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4121): Terminated: ok {rc=0} 00:49:00.658529 --- ParallelTerminationStrategy: PID 4122 died... 00:49:00.676667 run iperf3-srv_10.42.42.10(pid=4122): Terminated {rc=256} 00:49:00.720234 --- ParallelTerminationStrategy: PID 4123 died... 00:49:00.738390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4123): Terminated: ok {rc=0} 00:49:00.781860 --- ParallelTerminationStrategy: PID 4124 died... 00:49:00.800088 run iperf3-srv_10.42.42.10(pid=4124): Terminated {rc=256} 00:49:00.845236 --- ParallelTerminationStrategy: PID 4127 died... 00:49:00.864335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4127): Terminated: ok {rc=0} 00:49:00.911420 --- ParallelTerminationStrategy: PID 4130 died... 00:49:00.930427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4130): Terminated: ok {rc=0} 00:49:00.975045 --- ParallelTerminationStrategy: PID 4133 died... 00:49:00.993810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4133): Terminated: ok {rc=0} 00:49:01.083217 bus /gobi_0: Setting Powered False 00:49:02.186446 bus /gobi_0: Setting Powered False 00:49:03.300234 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 00:49:04.442425 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:04.453916 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:49:04.516167 tst iperf3.py: using LAC 24827 00:49:04.634084 tst iperf3.py: using RAC 92 00:49:04.750785 tst iperf3.py: using CellId 24827 00:49:04.869075 tst iperf3.py: using BVCI 24828 00:49:04.985652 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:04.997082 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:05.008374 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:05.019648 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:05.030820 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:05.042242 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:05.053562 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:05.064466 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:05.075565 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:49:05.189894 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:49:05.389023 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:49:05.686591 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4135): Launched 00:49:05.945752 run iperf3-srv_10.42.42.10(pid=4136): Launched 00:49:06.057896 tst iperf3.py:8: start network... 00:49:06.256900 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:49:06.715796 run create_hlr_db(pid=4137): Launched 00:49:06.829747 bus /gobi_6: Setting Powered False 00:49:07.888879 run create_hlr_db(pid=4137): Terminated: ok {rc=0} 00:49:08.322670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4139): Launched 00:49:08.642192 run osmo-hlr_10.42.42.2(pid=4140): Launched 00:49:08.765375 run osmo-stp_10.42.42.5: Starting osmo-stp 00:49:09.316466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4142): Launched 00:49:09.635374 run osmo-stp_10.42.42.5(pid=4143): Launched 00:49:09.758871 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:49:10.311712 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4145): Launched 00:49:10.434635 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:49:10.704013 run patchelf(pid=4146): Launched 00:49:10.882349 run osmo-stp_10.42.42.5(pid=4143): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4143)] 00:49:11.017846 run osmo-stp_10.42.42.5(pid=4143): stdout: | (launched: 2022-12-10_00:49:09.577624) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:49:11.154380 run osmo-stp_10.42.42.5(pid=4143): stderr: | 20221210004909768 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004909768 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004909768 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004909769 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004909771 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004909771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004909771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:49:11.291453 run osmo-stp_10.42.42.5(pid=4143): stdout: | (launched: 2022-12-10_00:49:09.577624) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:49:11.423104 run osmo-stp_10.42.42.5(pid=4143): stderr: | 20221210004909768 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004909768 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004909768 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004909769 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004909771 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004909771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004909771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:49:11.578871 run patchelf(pid=4146): Terminating (SIGINT) 00:49:11.757335 run patchelf(pid=4146): Terminated: ok {rc=0} 00:49:11.886163 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4143): Process ended prematurely: osmo-stp_10.42.42.5(pid=4143) [trial-2367↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4143)] [trial-2367↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 00:49:11.895986 tst iperf3.py:8: Test FAILED (7.5 sec) 00:49:11.924175 run osmo-hlr_10.42.42.2(pid=4140): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4140)] 00:49:11.974081 run osmo-hlr_10.42.42.2(pid=4140): stdout: | (launched: 2022-12-10_00:49:08.584625) 00:49:12.025521 run osmo-hlr_10.42.42.2(pid=4140): stderr: | 20221210004908782 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004908782 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004908783 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004908783 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004908783 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004908783 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004908795 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004908803 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004908803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004908803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:49:12.077507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4135): Terminating (SIGTERM) 00:49:12.119068 run iperf3-srv_10.42.42.10(pid=4136): Terminating (SIGTERM) 00:49:12.161119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4139): Terminating (SIGTERM) 00:49:12.202884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4142): Terminating (SIGTERM) 00:49:12.244858 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4145): Terminating (SIGTERM) 00:49:12.286611 --- ParallelTerminationStrategy: PID 4135 died... 00:49:12.306543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4135): Terminated: ok {rc=0} 00:49:12.352813 --- ParallelTerminationStrategy: PID 4136 died... 00:49:12.372368 run iperf3-srv_10.42.42.10(pid=4136): Terminated {rc=256} 00:49:12.417695 --- ParallelTerminationStrategy: PID 4139 died... 00:49:12.437107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4139): Terminated: ok {rc=0} 00:49:12.482820 --- ParallelTerminationStrategy: PID 4142 died... 00:49:12.502401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4142): Terminated: ok {rc=0} 00:49:12.547925 --- ParallelTerminationStrategy: PID 4145 died... 00:49:12.567388 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4145): Terminated: ok {rc=0} 00:49:12.654475 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 00:49:13.801913 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:13.813236 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:49:13.873189 tst iperf3m4.py: using LAC 24828 00:49:13.990531 tst iperf3m4.py: using RAC 93 00:49:14.105573 tst iperf3m4.py: using CellId 24828 00:49:14.222258 tst iperf3m4.py: using BVCI 24829 00:49:14.330803 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:14.341805 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:14.352412 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:14.363920 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:14.375092 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:14.386324 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:14.397660 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:14.408842 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:14.420365 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:49:14.539889 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:49:14.661999 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:49:14.782940 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:49:14.902568 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:49:15.117731 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:49:15.437426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4147): Launched 00:49:15.716203 run iperf3-srv_10.42.42.10(pid=4148): Launched 00:49:15.840619 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:49:16.072590 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:49:16.410119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4149): Launched 00:49:16.705041 run iperf3-srv_10.42.42.10(pid=4150): Launched 00:49:16.840492 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:49:17.058031 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:49:17.378326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4151): Launched 00:49:17.655937 run iperf3-srv_10.42.42.10(pid=4152): Launched 00:49:17.776401 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:49:17.989760 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:49:18.308725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4154): Launched 00:49:18.585688 run iperf3-srv_10.42.42.10(pid=4155): Launched 00:49:18.705865 tst iperf3m4.py:8: start network... 00:49:18.921384 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:49:19.417518 run create_hlr_db(pid=4156): Launched 00:49:19.548170 bus /gobi_6: Setting Powered False 00:49:20.611878 run create_hlr_db(pid=4156): Terminated: ok {rc=0} 00:49:21.055722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4158): Launched 00:49:21.375566 run osmo-hlr_10.42.42.2(pid=4159): Launched 00:49:21.498221 run osmo-stp_10.42.42.5: Starting osmo-stp 00:49:22.052208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4161): Launched 00:49:22.373031 run osmo-stp_10.42.42.5(pid=4162): Launched 00:49:22.495437 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:49:23.051540 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4164): Launched 00:49:23.175142 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:49:23.445243 run patchelf(pid=4165): Launched 00:49:23.624133 run osmo-stp_10.42.42.5(pid=4162): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4162)] 00:49:23.759857 run osmo-stp_10.42.42.5(pid=4162): stdout: | (launched: 2022-12-10_00:49:22.314747) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:49:23.897239 run osmo-stp_10.42.42.5(pid=4162): stderr: | 20221210004922505 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004922505 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004922506 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004922506 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004922506 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004922507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004922507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:49:24.034068 run osmo-stp_10.42.42.5(pid=4162): stdout: | (launched: 2022-12-10_00:49:22.314747) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:49:24.166036 run osmo-stp_10.42.42.5(pid=4162): stderr: | 20221210004922505 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004922505 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004922506 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004922506 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004922506 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004922507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004922507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:49:24.322246 run patchelf(pid=4165): Terminating (SIGINT) 00:49:24.500876 run patchelf(pid=4165): Terminated: ok {rc=0} 00:49:24.629733 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4162): Process ended prematurely: osmo-stp_10.42.42.5(pid=4162) [trial-2367↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4162)] [trial-2367↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 00:49:24.639957 tst iperf3m4.py:8: Test FAILED (10.9 sec) 00:49:24.668591 run osmo-hlr_10.42.42.2(pid=4159): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4159)] 00:49:24.718410 run osmo-hlr_10.42.42.2(pid=4159): stdout: | (launched: 2022-12-10_00:49:21.317424) 00:49:24.770360 run osmo-hlr_10.42.42.2(pid=4159): stderr: | 20221210004921514 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004921514 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004921514 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004921514 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004921514 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004921514 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004921527 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004921537 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004921537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004921537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:49:24.822453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4147): Terminating (SIGTERM) 00:49:24.864098 run iperf3-srv_10.42.42.10(pid=4148): Terminating (SIGTERM) 00:49:24.905688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4149): Terminating (SIGTERM) 00:49:24.947332 run iperf3-srv_10.42.42.10(pid=4150): Terminating (SIGTERM) 00:49:24.988819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4151): Terminating (SIGTERM) 00:49:25.030677 run iperf3-srv_10.42.42.10(pid=4152): Terminating (SIGTERM) 00:49:25.072099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4154): Terminating (SIGTERM) 00:49:25.113837 run iperf3-srv_10.42.42.10(pid=4155): Terminating (SIGTERM) 00:49:25.155291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4158): Terminating (SIGTERM) 00:49:25.196904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4161): Terminating (SIGTERM) 00:49:25.238625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4164): Terminating (SIGTERM) 00:49:25.280436 --- ParallelTerminationStrategy: PID 4147 died... 00:49:25.300458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4147): Terminated: ok {rc=0} 00:49:25.346630 --- ParallelTerminationStrategy: PID 4148 died... 00:49:25.366130 run iperf3-srv_10.42.42.10(pid=4148): Terminated {rc=256} 00:49:25.411871 --- ParallelTerminationStrategy: PID 4149 died... 00:49:25.431450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4149): Terminated: ok {rc=0} 00:49:25.477265 --- ParallelTerminationStrategy: PID 4150 died... 00:49:25.496543 run iperf3-srv_10.42.42.10(pid=4150): Terminated {rc=256} 00:49:25.542336 --- ParallelTerminationStrategy: PID 4151 died... 00:49:25.561877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4151): Terminated: ok {rc=0} 00:49:25.607842 --- ParallelTerminationStrategy: PID 4152 died... 00:49:25.627344 run iperf3-srv_10.42.42.10(pid=4152): Terminated {rc=256} 00:49:25.672809 --- ParallelTerminationStrategy: PID 4154 died... 00:49:25.692373 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4154): Terminated: ok {rc=0} 00:49:25.738628 --- ParallelTerminationStrategy: PID 4155 died... 00:49:25.758206 run iperf3-srv_10.42.42.10(pid=4155): Terminated {rc=256} 00:49:25.803998 --- ParallelTerminationStrategy: PID 4158 died... 00:49:25.823604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4158): Terminated: ok {rc=0} 00:49:25.869468 --- ParallelTerminationStrategy: PID 4161 died... 00:49:25.889066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4161): Terminated: ok {rc=0} 00:49:25.934730 --- ParallelTerminationStrategy: PID 4164 died... 00:49:25.954182 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4164): Terminated: ok {rc=0} 00:49:26.040984 bus /gobi_4: Setting Powered False 00:49:27.139230 bus /gobi_4: Setting Powered False 00:49:28.254603 bus /gobi_1: Setting Powered False 00:49:29.353826 bus /gobi_1: Setting Powered False 00:49:30.468779 bus /gobi_0: Setting Powered False 00:49:31.566592 bus /gobi_0: Setting Powered False 00:49:32.681697 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 00:49:33.785585 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:33.797586 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:49:33.856679 tst ping.py: using LAC 24829 00:49:33.973292 tst ping.py: using RAC 94 00:49:34.089733 tst ping.py: using CellId 24829 00:49:34.213905 tst ping.py: using BVCI 24830 00:49:34.328183 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:34.339639 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:34.350813 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:34.362290 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:34.373461 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:34.384769 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:34.396291 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:34.407555 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:49:34.520166 tst ping.py:19: start network... 00:49:34.715326 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:49:35.166505 run create_hlr_db(pid=4166): Launched 00:49:35.278718 bus /gobi_6: Setting Powered False 00:49:36.337073 run create_hlr_db(pid=4166): Terminated: ok {rc=0} 00:49:36.767685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4168): Launched 00:49:37.082609 run osmo-hlr_10.42.42.2(pid=4169): Launched 00:49:37.203040 run osmo-stp_10.42.42.5: Starting osmo-stp 00:49:37.749398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4171): Launched 00:49:38.062834 run osmo-stp_10.42.42.5(pid=4172): Launched 00:49:38.182794 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:49:38.721785 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4174): Launched 00:49:38.842579 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:49:39.107194 run patchelf(pid=4175): Launched 00:49:39.282230 run osmo-stp_10.42.42.5(pid=4172): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4172)] 00:49:39.414866 run osmo-stp_10.42.42.5(pid=4172): stdout: | (launched: 2022-12-10_00:49:38.006019) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:49:39.549169 run osmo-stp_10.42.42.5(pid=4172): stderr: | 20221210004938195 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004938195 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004938195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004938195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004938196 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004938196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004938196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:49:39.683477 run osmo-stp_10.42.42.5(pid=4172): stdout: | (launched: 2022-12-10_00:49:38.006019) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:49:39.812865 run osmo-stp_10.42.42.5(pid=4172): stderr: | 20221210004938195 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004938195 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004938195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004938195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004938196 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004938196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004938196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:49:39.966007 run patchelf(pid=4175): Terminating (SIGINT) 00:49:40.141188 run patchelf(pid=4175): Terminated: ok {rc=0} 00:49:40.267306 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4172): Process ended prematurely: osmo-stp_10.42.42.5(pid=4172) [trial-2367↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4172)] [trial-2367↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 00:49:40.276517 tst ping.py:22: Test FAILED (6.5 sec) 00:49:40.304378 run osmo-hlr_10.42.42.2(pid=4169): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4169)] 00:49:40.354381 run osmo-hlr_10.42.42.2(pid=4169): stdout: | (launched: 2022-12-10_00:49:37.025519) 00:49:40.406109 run osmo-hlr_10.42.42.2(pid=4169): stderr: | 20221210004937220 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004937220 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004937220 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004937220 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004937220 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004937220 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004937233 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004937241 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004937241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004937241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:49:40.458623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4168): Terminating (SIGTERM) 00:49:40.500293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4171): Terminating (SIGTERM) 00:49:40.542040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4174): Terminating (SIGTERM) 00:49:40.584010 --- ParallelTerminationStrategy: PID 4168 died... 00:49:40.603941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4168): Terminated: ok {rc=0} 00:49:40.650244 --- ParallelTerminationStrategy: PID 4171 died... 00:49:40.669794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4171): Terminated: ok {rc=0} 00:49:40.715704 --- ParallelTerminationStrategy: PID 4174 died... 00:49:40.735578 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4174): Terminated: ok {rc=0} 00:49:40.823091 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 00:49:41.909982 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:41.921447 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:49:41.980638 tst ping_idle_ping.py: using LAC 24830 00:49:42.097368 tst ping_idle_ping.py: using RAC 95 00:49:42.214844 tst ping_idle_ping.py: using CellId 24830 00:49:42.336609 tst ping_idle_ping.py: using BVCI 24831 00:49:42.445698 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:42.456651 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:42.467266 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:42.478642 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:42.489930 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:42.501261 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:42.512536 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:42.523933 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:49:42.640811 tst ping_idle_ping.py:24: start network... 00:49:42.852919 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:49:43.342708 run create_hlr_db(pid=4176): Launched 00:49:43.472143 bus /gobi_6: Setting Powered False 00:49:44.535300 run create_hlr_db(pid=4176): Terminated: ok {rc=0} 00:49:44.973129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4178): Launched 00:49:45.287709 run osmo-hlr_10.42.42.2(pid=4179): Launched 00:49:45.408787 run osmo-stp_10.42.42.5: Starting osmo-stp 00:49:45.971253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4181): Launched 00:49:46.303318 run osmo-stp_10.42.42.5(pid=4182): Launched 00:49:46.473939 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:49:47.137877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4184): Launched 00:49:47.265574 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:49:47.530391 run patchelf(pid=4185): Launched 00:49:47.705455 run osmo-stp_10.42.42.5(pid=4182): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4182)] 00:49:47.838912 run osmo-stp_10.42.42.5(pid=4182): stdout: | (launched: 2022-12-10_00:49:46.241710) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:49:47.973855 run osmo-stp_10.42.42.5(pid=4182): stderr: | 20221210004946570 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004946570 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004946571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004946571 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004946572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004946572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004946572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:49:48.108708 run osmo-stp_10.42.42.5(pid=4182): stdout: | (launched: 2022-12-10_00:49:46.241710) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:49:48.238385 run osmo-stp_10.42.42.5(pid=4182): stderr: | 20221210004946570 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004946570 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004946571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004946571 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004946572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004946572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004946572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:49:48.391761 run patchelf(pid=4185): Terminating (SIGINT) 00:49:48.568448 run patchelf(pid=4185): Terminated: ok {rc=0} 00:49:48.694926 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4182): Process ended prematurely: osmo-stp_10.42.42.5(pid=4182) [trial-2367↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4182)] [trial-2367↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 00:49:48.704092 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 00:49:48.731898 run osmo-hlr_10.42.42.2(pid=4179): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4179)] 00:49:48.782048 run osmo-hlr_10.42.42.2(pid=4179): stdout: | (launched: 2022-12-10_00:49:45.230809) 00:49:48.833740 run osmo-hlr_10.42.42.2(pid=4179): stderr: | 20221210004945425 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004945426 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004945426 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004945426 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004945426 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004945426 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004945438 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004945447 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004945447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004945447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:49:48.885672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4178): Terminating (SIGTERM) 00:49:48.927119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4181): Terminating (SIGTERM) 00:49:48.968627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4184): Terminating (SIGTERM) 00:49:49.010462 --- ParallelTerminationStrategy: PID 4178 died... 00:49:49.030262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4178): Terminated: ok {rc=0} 00:49:49.075990 --- ParallelTerminationStrategy: PID 4181 died... 00:49:49.095401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4181): Terminated: ok {rc=0} 00:49:49.141215 --- ParallelTerminationStrategy: PID 4184 died... 00:49:49.160445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4184): Terminated: ok {rc=0} 00:49:49.247621 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 00:49:50.534600 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:49:50.541149 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 00:49:50.563168 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 00:49:50.598158 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 00:49:50.651743 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 00:49:50.672330 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 00:49:50.707610 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 00:49:51.265296 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2367 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 00:49:51.271438 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:49:51.283548 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:49:51.346555 tst switch_tch_pdch.py: using LAC 24831 00:49:51.469032 tst switch_tch_pdch.py: using RAC 96 00:49:51.590605 tst switch_tch_pdch.py: using CellId 24831 00:49:51.711925 tst switch_tch_pdch.py: using BVCI 24832 00:49:51.826476 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:49:51.838045 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:49:51.849442 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:49:51.860658 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:49:51.871886 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:49:51.883227 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:49:51.895348 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:49:51.907012 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:49:52.033781 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:49:52.148497 tst switch_tch_pdch.py:51: start network... 00:49:52.344032 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:49:52.796773 run create_hlr_db(pid=4190): Launched 00:49:52.910260 bus /gobi_6: Setting Powered False 00:49:53.967783 run create_hlr_db(pid=4190): Terminated: ok {rc=0} 00:49:54.395057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4192): Launched 00:49:54.707900 run osmo-hlr_10.42.42.2(pid=4193): Launched 00:49:54.828833 run osmo-stp_10.42.42.5: Starting osmo-stp 00:49:55.365637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4195): Launched 00:49:55.678948 run osmo-stp_10.42.42.5(pid=4196): Launched 00:49:55.799214 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:49:56.339050 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4198): Launched 00:49:56.459105 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:49:56.722521 run patchelf(pid=4199): Launched 00:49:56.896797 run osmo-stp_10.42.42.5(pid=4196): ERR: Terminated: ERROR {rc=1} [trial-2367↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4196)] 00:49:57.028809 run osmo-stp_10.42.42.5(pid=4196): stdout: | (launched: 2022-12-10_00:49:55.621914) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:49:57.162833 run osmo-stp_10.42.42.5(pid=4196): stderr: | 20221210004955813 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004955813 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004955813 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004955814 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004955814 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004955814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004955814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:49:57.296649 run osmo-stp_10.42.42.5(pid=4196): stdout: | (launched: 2022-12-10_00:49:55.621914) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:49:57.425487 run osmo-stp_10.42.42.5(pid=4196): stderr: | 20221210004955813 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210004955813 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210004955813 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210004955814 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210004955814 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210004955814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210004955814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:49:57.578353 run patchelf(pid=4199): Terminating (SIGINT) 00:49:57.754402 run patchelf(pid=4199): Terminated: ok {rc=0} 00:49:57.880615 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=4196): Process ended prematurely: osmo-stp_10.42.42.5(pid=4196) [trial-2367↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4196)] [trial-2367↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 00:49:57.889897 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 00:49:57.917929 run osmo-hlr_10.42.42.2(pid=4193): ERR: Terminated: ERROR {rc=237} [trial-2367↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4193)] 00:49:57.967251 run osmo-hlr_10.42.42.2(pid=4193): stdout: | (launched: 2022-12-10_00:49:54.651317) 00:49:58.018561 run osmo-hlr_10.42.42.2(pid=4193): stderr: | 20221210004954847 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210004954847 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210004954847 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210004954847 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210004954847 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210004954847 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210004954859 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210004954868 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210004954868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210004954868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:49:58.069965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4192): Terminating (SIGTERM) 00:49:58.111051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4195): Terminating (SIGTERM) 00:49:58.152176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4198): Terminating (SIGTERM) 00:49:58.193552 --- ParallelTerminationStrategy: PID 4192 died... 00:49:58.213334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4192): Terminated: ok {rc=0} 00:49:58.258990 --- ParallelTerminationStrategy: PID 4195 died... 00:49:58.278470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4195): Terminated: ok {rc=0} 00:49:58.324030 --- ParallelTerminationStrategy: PID 4198 died... 00:49:58.343391 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4198): Terminated: ok {rc=0} 00:49:58.429604 bus /gobi_0: Setting Powered False 00:49:59.527240 bus /gobi_0: Setting Powered False 00:50:00.642545 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 00:50:01.882134 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:50:01.888550 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 00:50:01.913849 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 00:50:01.963300 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 00:50:02.017423 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 00:50:02.039377 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 00:50:02.087689 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 00:50:02.630273 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2367 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 00:50:02.635932 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:50:02.649006 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 00:50:02.708228 tst switch_tch_pdch.py: using LAC 24832 00:50:02.830978 tst switch_tch_pdch.py: using RAC 97 00:50:02.953132 tst switch_tch_pdch.py: using CellId 24832 00:50:03.074203 tst switch_tch_pdch.py: using BVCI 24833 00:50:03.187810 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:50:03.199064 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:50:03.210163 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:50:03.221188 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:50:03.232073 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:50:03.242996 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:50:03.254208 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:50:03.265220 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 00:50:03.379203 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 00:50:03.497029 tst switch_tch_pdch.py:51: start network... 00:50:03.707528 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:50:04.166546 run create_hlr_db(pid=4213): Launched 00:50:04.293871 bus /gobi_6: Setting Powered False 00:50:05.356066 run create_hlr_db(pid=4213): Terminated: ok {rc=0} 00:50:05.750198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4215): Launched 00:50:06.041948 run osmo-hlr_10.42.42.2(pid=4216): Launched 00:50:06.153699 run osmo-stp_10.42.42.5: Starting osmo-stp 00:50:06.646346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4218): Launched 00:50:06.937640 run osmo-stp_10.42.42.5(pid=4219): Launched 00:50:07.050313 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:50:07.531013 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4221): Launched 00:50:07.655241 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:50:07.920763 run patchelf(pid=4222): Launched 00:50:08.095494 run osmo-stp_10.42.42.5(pid=4219): ERR: Terminated: ERROR {rc=1} [trial-2367↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4219)] 00:50:08.227908 run osmo-stp_10.42.42.5(pid=4219): stdout: | (launched: 2022-12-10_00:50:06.884370) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:50:08.362587 run osmo-stp_10.42.42.5(pid=4219): stderr: | 20221210005007051 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005007052 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005007052 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005007052 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005007053 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005007053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005007053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:50:08.496656 run osmo-stp_10.42.42.5(pid=4219): stdout: | (launched: 2022-12-10_00:50:06.884370) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:50:08.626214 run osmo-stp_10.42.42.5(pid=4219): stderr: | 20221210005007051 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005007052 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005007052 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005007052 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005007053 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005007053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005007053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:50:08.780055 run patchelf(pid=4222): Terminating (SIGINT) 00:50:08.954795 run patchelf(pid=4222): Terminated: ok {rc=0} 00:50:09.080889 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=4219): Process ended prematurely: osmo-stp_10.42.42.5(pid=4219) [trial-2367↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4219)] [trial-2367↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 00:50:09.090296 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 00:50:09.118062 run osmo-hlr_10.42.42.2(pid=4216): ERR: Terminated: ERROR {rc=237} [trial-2367↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4216)] 00:50:09.167642 run osmo-hlr_10.42.42.2(pid=4216): stdout: | (launched: 2022-12-10_00:50:05.988320) 00:50:09.218939 run osmo-hlr_10.42.42.2(pid=4216): stderr: | 20221210005006162 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005006162 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005006162 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005006162 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005006162 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005006162 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005006174 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005006183 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005006183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005006183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:50:09.270986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4215): Terminating (SIGTERM) 00:50:09.312507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4218): Terminating (SIGTERM) 00:50:09.354281 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4221): Terminating (SIGTERM) 00:50:09.396139 --- ParallelTerminationStrategy: PID 4215 died... 00:50:09.416000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4215): Terminated: ok {rc=0} 00:50:09.462183 --- ParallelTerminationStrategy: PID 4218 died... 00:50:09.481466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4218): Terminated: ok {rc=0} 00:50:09.527368 --- ParallelTerminationStrategy: PID 4221 died... 00:50:09.546545 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4221): Terminated: ok {rc=0} 00:50:09.632717 bus /gobi_0: Setting Powered False 00:50:10.730559 bus /gobi_0: Setting Powered False 00:50:11.843729 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 nitb_sms:oc2g --------------------------------------------------------------------- 00:50:13.084048 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:50:13.088397 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 00:50:13.111715 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 00:50:13.120285 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 00:50:13.176374 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 00:50:13.197898 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 00:50:13.205277 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 00:50:13.741527 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 00:50:13.748070 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 00:50:13.760491 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 00:50:13.798547 tst mo_mt_sms.py: using LAC 24833 00:50:13.919352 tst mo_mt_sms.py: using RAC 98 00:50:14.047124 tst mo_mt_sms.py: using CellId 24833 00:50:14.174294 tst mo_mt_sms.py: using BVCI 24834 00:50:14.284219 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 00:50:14.400526 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 00:50:14.516817 tst mo_mt_sms.py:9: start nitb and bts... 00:50:14.731945 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:50:15.373627 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4577): Launched 00:50:15.689437 run osmo-nitb_10.42.42.2(pid=4578): Launched 00:50:15.890255 run osmo-nitb_10.42.42.2(pid=4578): ERR: Terminated: ERROR {rc=2} [trial-2367↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4578)] 00:50:16.030722 run osmo-nitb_10.42.42.2(pid=4578): stdout: | (launched: 2022-12-10_00:50:15.632305) 00:50:16.169233 run osmo-nitb_10.42.42.2(pid=4578): stderr: | (launched: 2022-12-10_00:50:15.679279) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:50:16.307021 run osmo-nitb_10.42.42.2(pid=4578): stdout: | (launched: 2022-12-10_00:50:15.632305) 00:50:16.439865 run osmo-nitb_10.42.42.2(pid=4578): stderr: | (launched: 2022-12-10_00:50:15.679279) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=4578): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4578) [trial-2367↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4578)] 00:50:16.808645 tst osmo-nitb_10.42.42.2(pid=4578): stdout: | (launched: 2022-12-10_00:50:15.632305) 00:50:16.967443 tst osmo-nitb_10.42.42.2(pid=4578): stderr: | (launched: 2022-12-10_00:50:15.679279) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:50:17.145863 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=4578): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4578) [trial-2367↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4578)] [trial-2367↪nitb_sms:oc2g↪mo_mt_sms.py:11] 00:50:17.155260 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 00:50:17.162881 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4577): Terminating (SIGTERM) 00:50:17.375367 --- ParallelTerminationStrategy: PID 4577 died... 00:50:17.397372 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4577): Terminated: ok {rc=0} 00:50:17.484128 bus /sierra_3: Setting Powered False 00:50:18.583636 bus /sierra_3: Setting Powered False 00:50:19.701064 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 sms:oc2g --------------------------------------------------------------------- 00:50:20.878093 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:50:20.881895 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 00:50:20.901868 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 00:50:20.929396 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 00:50:20.979664 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 00:50:20.999635 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 00:50:21.025624 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 00:50:21.570901 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 sms:oc2g mo_mt_sms.py ---------------------------------------------- 00:50:21.577271 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 00:50:21.588085 tst sms:oc2g: Using 1 x bts (candidates: 1) 00:50:21.622201 tst mo_mt_sms.py: using LAC 24834 00:50:21.745169 tst mo_mt_sms.py: using RAC 99 00:50:21.868649 tst mo_mt_sms.py: using CellId 24834 00:50:21.991236 tst mo_mt_sms.py: using BVCI 24835 00:50:22.104396 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 00:50:22.115238 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 00:50:22.125974 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 00:50:22.136578 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 00:50:22.147201 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 00:50:22.157875 tst sms:oc2g: Using 1 x modem (candidates: 2) 00:50:22.272224 tst sms:oc2g: Using 1 x modem (candidates: 2) 00:50:22.387933 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:50:22.876193 run create_hlr_db(pid=4584): Launched 00:50:23.014830 bus /sierra_2: Setting Powered False 00:50:24.074045 run create_hlr_db(pid=4584): Terminated: ok {rc=0} 00:50:24.501208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4761): Launched 00:50:24.815681 run osmo-hlr_10.42.42.2(pid=4762): Launched 00:50:25.047555 run osmo-stp_10.42.42.5: Starting osmo-stp 00:50:25.736591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4764): Launched 00:50:26.051258 run osmo-stp_10.42.42.5(pid=4765): Launched 00:50:26.288158 run osmo-msc_10.42.42.6: Starting osmo-msc 00:50:26.967878 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4767): Launched 00:50:27.282872 run osmo-msc_10.42.42.6(pid=4768): Launched 00:50:27.629442 run osmo-stp_10.42.42.5(pid=4765): ERR: Terminated: ERROR {rc=1} [trial-2367↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4765)] 00:50:27.884727 run osmo-stp_10.42.42.5(pid=4765): stdout: | (launched: 2022-12-10_00:50:25.990704) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:50:28.156758 run osmo-stp_10.42.42.5(pid=4765): stderr: | 20221210005026310 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005026310 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005026311 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005026311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005026312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005026312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005026312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:50:28.324357 run osmo-stp_10.42.42.5(pid=4765): stdout: | (launched: 2022-12-10_00:50:25.990704) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:50:28.445796 run osmo-stp_10.42.42.5(pid=4765): stderr: | 20221210005026310 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005026310 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005026311 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005026311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005026312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005026312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005026312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:50:28.593026 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=4765): Process ended prematurely: osmo-stp_10.42.42.5(pid=4765) [trial-2367↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4765)] [trial-2367↪sms:oc2g↪mo_mt_sms.py:16] 00:50:28.602517 tst mo_mt_sms.py:16: Test FAILED (7.0 sec) 00:50:28.633047 run osmo-hlr_10.42.42.2(pid=4762): ERR: Terminated: ERROR {rc=237} [trial-2367↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4762)] 00:50:28.685035 run osmo-hlr_10.42.42.2(pid=4762): stdout: | (launched: 2022-12-10_00:50:24.755887) 00:50:28.737079 run osmo-hlr_10.42.42.2(pid=4762): stderr: | 20221210005025089 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005025089 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005025089 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005025089 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005025089 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005025089 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005025111 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005025123 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005025125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005025125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:50:28.808272 run osmo-msc_10.42.42.6(pid=4768): ERR: Terminated: ERROR {rc=2} [trial-2367↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4768)] 00:50:28.856763 run osmo-msc_10.42.42.6(pid=4768): stdout: | (launched: 2022-12-10_00:50:27.225340) 00:50:28.906920 run osmo-msc_10.42.42.6(pid=4768): stderr: | 20221210005027817 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210005027817 DLGLOBAL DEBUG validating counter group 0x7f758bbcfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210005027817 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210005027817 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210005027818 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210005027818 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210005027819 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210005027820 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210005027820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210005027820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:50:28.956773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4761): Terminating (SIGTERM) 00:50:28.997282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4764): Terminating (SIGTERM) 00:50:29.037513 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4767): Terminating (SIGTERM) 00:50:29.077597 --- ParallelTerminationStrategy: PID 4761 died... 00:50:29.096540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4761): Terminated: ok {rc=0} 00:50:29.140755 --- ParallelTerminationStrategy: PID 4764 died... 00:50:29.159480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4764): Terminated: ok {rc=0} 00:50:29.203797 --- ParallelTerminationStrategy: PID 4767 died... 00:50:29.222494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4767): Terminated: ok {rc=0} 00:50:29.306290 bus /sierra_3: Setting Powered False 00:50:30.403532 bus /sierra_3: Setting Powered False 00:50:31.543713 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 nitb_ussd:oc2g --------------------------------------------------------------------- 00:50:32.773578 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:50:32.777700 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 00:50:32.798771 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 00:50:32.805780 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 00:50:32.839876 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 00:50:32.861798 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 00:50:32.868838 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 00:50:33.389791 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2367 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 00:50:33.394820 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 00:50:33.405831 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 00:50:33.441486 tst assert_extension.py: using LAC 24835 00:50:33.562212 tst assert_extension.py: using RAC 100 00:50:33.676939 tst assert_extension.py: using CellId 24835 00:50:33.789874 tst assert_extension.py: using BVCI 24836 00:50:33.895585 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 00:50:34.011119 tst assert_extension.py:10: start nitb and bts... 00:50:34.224647 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:50:34.869585 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4774): Launched 00:50:35.188421 run osmo-nitb_10.42.42.2(pid=4775): Launched 00:50:35.364523 run osmo-nitb_10.42.42.2(pid=4775): ERR: Terminated: ERROR {rc=2} [trial-2367↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4775)] 00:50:35.506682 run osmo-nitb_10.42.42.2(pid=4775): stdout: | (launched: 2022-12-10_00:50:35.130557) 00:50:35.650339 run osmo-nitb_10.42.42.2(pid=4775): stderr: | (launched: 2022-12-10_00:50:35.177874) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:50:35.794007 run osmo-nitb_10.42.42.2(pid=4775): stdout: | (launched: 2022-12-10_00:50:35.130557) 00:50:35.931928 run osmo-nitb_10.42.42.2(pid=4775): stderr: | (launched: 2022-12-10_00:50:35.177874) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=4775): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4775) [trial-2367↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4775)] 00:50:36.308868 tst osmo-nitb_10.42.42.2(pid=4775): stdout: | (launched: 2022-12-10_00:50:35.130557) 00:50:36.436652 tst osmo-nitb_10.42.42.2(pid=4775): stderr: | (launched: 2022-12-10_00:50:35.177874) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:50:36.587758 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=4775): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4775) [trial-2367↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4775)] [trial-2367↪nitb_ussd:oc2g↪assert_extension.py:12] 00:50:36.596626 tst assert_extension.py:12: Test FAILED (3.2 sec) 00:50:36.603666 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4774): Terminating (SIGTERM) 00:50:36.814864 --- ParallelTerminationStrategy: PID 4774 died... 00:50:36.837427 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4774): Terminated: ok {rc=0} 00:50:36.932574 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 ussd:oc2g --------------------------------------------------------------------- 00:50:38.093074 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:50:38.097681 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 00:50:38.118873 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 00:50:38.145640 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 00:50:38.185790 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 00:50:38.206931 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 00:50:38.233458 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 00:50:38.755057 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2367 ussd:oc2g assert_extension.py ---------------------------------------------- 00:50:38.760199 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 00:50:38.770806 tst ussd:oc2g: Using 1 x bts (candidates: 1) 00:50:38.805828 tst assert_extension.py: using LAC 24836 00:50:38.930186 tst assert_extension.py: using RAC 101 00:50:39.052172 tst assert_extension.py: using CellId 24836 00:50:39.174874 tst assert_extension.py: using BVCI 24837 00:50:39.289268 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 00:50:39.300158 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 00:50:39.311072 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 00:50:39.321747 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 00:50:39.332408 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 00:50:39.343069 tst ussd:oc2g: Using 1 x modem (candidates: 1) 00:50:39.455632 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:50:39.909937 run create_hlr_db(pid=4779): Launched 00:50:40.042409 bus /sierra_2: Setting Powered False 00:50:41.104794 run create_hlr_db(pid=4779): Terminated: ok {rc=0} 00:50:41.525416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4781): Launched 00:50:41.821743 run osmo-hlr_10.42.42.2(pid=4782): Launched 00:50:41.935997 run osmo-stp_10.42.42.5: Starting osmo-stp 00:50:42.467096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4784): Launched 00:50:42.762734 run osmo-stp_10.42.42.5(pid=4785): Launched 00:50:42.875448 run osmo-msc_10.42.42.6: Starting osmo-msc 00:50:43.405897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4787): Launched 00:50:43.701477 run osmo-msc_10.42.42.6(pid=4788): Launched 00:50:43.867657 run osmo-stp_10.42.42.5(pid=4785): ERR: Terminated: ERROR {rc=1} [trial-2367↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4785)] 00:50:43.993932 run osmo-stp_10.42.42.5(pid=4785): stdout: | (launched: 2022-12-10_00:50:42.708283) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:50:44.120402 run osmo-stp_10.42.42.5(pid=4785): stderr: | 20221210005042879 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005042879 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005042879 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005042879 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005042880 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005042880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005042880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:50:44.244066 run osmo-stp_10.42.42.5(pid=4785): stdout: | (launched: 2022-12-10_00:50:42.708283) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:50:44.362244 run osmo-stp_10.42.42.5(pid=4785): stderr: | 20221210005042879 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005042879 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005042879 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005042879 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005042880 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005042880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005042880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:50:44.503177 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=4785): Process ended prematurely: osmo-stp_10.42.42.5(pid=4785) [trial-2367↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4785)] [trial-2367↪ussd:oc2g↪assert_extension.py:17] 00:50:44.511661 tst assert_extension.py:17: Test FAILED (5.7 sec) 00:50:44.538411 run osmo-hlr_10.42.42.2(pid=4782): ERR: Terminated: ERROR {rc=237} [trial-2367↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4782)] 00:50:44.586716 run osmo-hlr_10.42.42.2(pid=4782): stdout: | (launched: 2022-12-10_00:50:41.767403) 00:50:44.636283 run osmo-hlr_10.42.42.2(pid=4782): stderr: | 20221210005041941 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005041941 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005041941 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005041941 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005041941 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005041941 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005041954 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005041962 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005041962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005041963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:50:44.705420 run osmo-msc_10.42.42.6(pid=4788): ERR: Terminated: ERROR {rc=2} [trial-2367↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4788)] 00:50:44.753306 run osmo-msc_10.42.42.6(pid=4788): stdout: | (launched: 2022-12-10_00:50:43.647206) 00:50:44.802657 run osmo-msc_10.42.42.6(pid=4788): stderr: | 20221210005043920 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210005043921 DLGLOBAL DEBUG validating counter group 0x7f06fccedc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210005043921 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210005043921 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210005043922 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210005043922 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210005043923 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210005043925 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210005043925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210005043925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:50:44.853040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4781): Terminating (SIGTERM) 00:50:44.893041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4784): Terminating (SIGTERM) 00:50:44.933250 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4787): Terminating (SIGTERM) 00:50:44.974006 --- ParallelTerminationStrategy: PID 4781 died... 00:50:44.993119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4781): Terminated: ok {rc=0} 00:50:45.037733 --- ParallelTerminationStrategy: PID 4784 died... 00:50:45.056247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4784): Terminated: ok {rc=0} 00:50:45.101115 --- ParallelTerminationStrategy: PID 4787 died... 00:50:45.119631 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4787): Terminated: ok {rc=0} 00:50:45.206903 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 00:50:46.416103 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:50:46.422869 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 00:50:46.446369 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 00:50:46.474617 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 00:50:46.527375 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 00:50:46.549919 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 00:50:46.578859 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 00:50:47.132320 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 00:50:47.188159 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:50:47.200019 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:50:47.259678 tst mo_mt_call.py: using LAC 24837 00:50:47.387854 tst mo_mt_call.py: using RAC 102 00:50:47.513895 tst mo_mt_call.py: using CellId 24837 00:50:47.638737 tst mo_mt_call.py: using BVCI 24838 00:50:47.755926 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:50:47.767786 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:50:47.778998 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:50:47.790240 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:50:47.801557 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:50:47.812996 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:50:47.931675 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:50:48.048346 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:50:48.515470 run create_hlr_db(pid=4793): Launched 00:50:48.632646 bus /sierra_2: Setting Powered False 00:50:49.692820 run create_hlr_db(pid=4793): Terminated: ok {rc=0} 00:50:50.111211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4795): Launched 00:50:50.412032 run osmo-hlr_10.42.42.2(pid=4796): Launched 00:50:50.527758 run osmo-stp_10.42.42.5: Starting osmo-stp 00:50:51.056117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4798): Launched 00:50:51.379807 run osmo-stp_10.42.42.5(pid=4799): Launched 00:50:51.503240 run osmo-msc_10.42.42.6: Starting osmo-msc 00:50:52.086397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4801): Launched 00:50:52.408239 run osmo-msc_10.42.42.6(pid=4802): Launched 00:50:52.588068 run osmo-stp_10.42.42.5(pid=4799): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4799)] 00:50:52.723936 run osmo-stp_10.42.42.5(pid=4799): stdout: | (launched: 2022-12-10_00:50:51.321066) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:50:52.860416 run osmo-stp_10.42.42.5(pid=4799): stderr: | 20221210005051511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005051511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005051511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005051511 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005051512 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005051512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005051512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:50:52.995816 run osmo-stp_10.42.42.5(pid=4799): stdout: | (launched: 2022-12-10_00:50:51.321066) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:50:53.124508 run osmo-stp_10.42.42.5(pid=4799): stderr: | 20221210005051511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005051511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005051511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005051511 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005051512 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005051512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005051512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:50:53.277962 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4799): Process ended prematurely: osmo-stp_10.42.42.5(pid=4799) [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4799)] [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 00:50:53.287496 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 00:50:53.315271 run osmo-hlr_10.42.42.2(pid=4796): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4796)] 00:50:53.365825 run osmo-hlr_10.42.42.2(pid=4796): stdout: | (launched: 2022-12-10_00:50:50.356800) 00:50:53.417656 run osmo-hlr_10.42.42.2(pid=4796): stderr: | 20221210005050531 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005050531 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005050531 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005050531 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005050531 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005050531 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005050549 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005050559 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005050559 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005050559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:50:53.489869 run osmo-msc_10.42.42.6(pid=4802): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4802)] 00:50:53.539886 run osmo-msc_10.42.42.6(pid=4802): stdout: | (launched: 2022-12-10_00:50:52.349450) 00:50:53.591615 run osmo-msc_10.42.42.6(pid=4802): stderr: | 20221210005052672 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210005052672 DLGLOBAL DEBUG validating counter group 0x7f8543265c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210005052672 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210005052672 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210005052672 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210005052673 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210005052674 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210005052675 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210005052675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210005052675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:50:53.643704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4795): Terminating (SIGTERM) 00:50:53.685510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4798): Terminating (SIGTERM) 00:50:53.727267 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4801): Terminating (SIGTERM) 00:50:53.769706 --- ParallelTerminationStrategy: PID 4795 died... 00:50:53.789635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4795): Terminated: ok {rc=0} 00:50:53.835793 --- ParallelTerminationStrategy: PID 4798 died... 00:50:53.855264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4798): Terminated: ok {rc=0} 00:50:53.901122 --- ParallelTerminationStrategy: PID 4801 died... 00:50:53.920639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4801): Terminated: ok {rc=0} 00:50:54.008080 bus /sierra_3: Setting Powered False 00:50:55.106453 bus /sierra_3: Setting Powered False 00:50:56.223127 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 00:50:57.373261 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:50:57.385312 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:50:57.443276 tst mo_mt_call_osmux.py: using LAC 24838 00:50:57.568891 tst mo_mt_call_osmux.py: using RAC 103 00:50:57.695497 tst mo_mt_call_osmux.py: using CellId 24838 00:50:57.821433 tst mo_mt_call_osmux.py: using BVCI 24839 00:50:57.937629 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:50:57.949255 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:50:57.960709 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:50:57.972162 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:50:57.983440 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:50:57.994890 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:50:58.109225 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:50:58.223260 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:50:58.690955 run create_hlr_db(pid=4804): Launched 00:50:58.806249 bus /sierra_2: Setting Powered False 00:50:59.866332 run create_hlr_db(pid=4804): Terminated: ok {rc=0} 00:51:00.282816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4806): Launched 00:51:00.585025 run osmo-hlr_10.42.42.2(pid=4807): Launched 00:51:00.732870 run osmo-stp_10.42.42.5: Starting osmo-stp 00:51:01.318515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4811): Launched 00:51:01.636480 run osmo-stp_10.42.42.5(pid=4812): Launched 00:51:01.974235 run osmo-msc_10.42.42.6: Starting osmo-msc 00:51:02.665715 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4814): Launched 00:51:02.989193 run osmo-msc_10.42.42.6(pid=4815): Launched 00:51:03.170725 run osmo-stp_10.42.42.5(pid=4812): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4812)] 00:51:03.306904 run osmo-stp_10.42.42.5(pid=4812): stdout: | (launched: 2022-12-10_00:51:01.576171) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:51:03.443023 run osmo-stp_10.42.42.5(pid=4812): stderr: | 20221210005101863 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005101863 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005101864 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005101865 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005101871 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005101872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005101872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:51:03.578220 run osmo-stp_10.42.42.5(pid=4812): stdout: | (launched: 2022-12-10_00:51:01.576171) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:51:03.706787 run osmo-stp_10.42.42.5(pid=4812): stderr: | 20221210005101863 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005101863 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005101864 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005101865 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005101871 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005101872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005101872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:51:03.862263 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4812): Process ended prematurely: osmo-stp_10.42.42.5(pid=4812) [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4812)] [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 00:51:03.871761 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 00:51:03.899762 run osmo-hlr_10.42.42.2(pid=4807): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4807)] 00:51:03.950082 run osmo-hlr_10.42.42.2(pid=4807): stdout: | (launched: 2022-12-10_00:51:00.527785) 00:51:04.002183 run osmo-hlr_10.42.42.2(pid=4807): stderr: | 20221210005100758 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005100758 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005100758 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005100758 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005100758 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005100758 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005100792 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005100801 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005100802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005100802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:51:04.074642 run osmo-msc_10.42.42.6(pid=4815): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4815)] 00:51:04.124501 run osmo-msc_10.42.42.6(pid=4815): stdout: | (launched: 2022-12-10_00:51:02.930102) 00:51:04.176067 run osmo-msc_10.42.42.6(pid=4815): stderr: | 20221210005103252 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210005103252 DLGLOBAL DEBUG validating counter group 0x7f1ecb024c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210005103252 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210005103253 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210005103253 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210005103253 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210005103254 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210005103255 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210005103255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210005103255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:51:04.228155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4806): Terminating (SIGTERM) 00:51:04.269774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4811): Terminating (SIGTERM) 00:51:04.311363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4814): Terminating (SIGTERM) 00:51:04.353510 --- ParallelTerminationStrategy: PID 4806 died... 00:51:04.373467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4806): Terminated: ok {rc=0} 00:51:04.419717 --- ParallelTerminationStrategy: PID 4811 died... 00:51:04.439337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4811): Terminated: ok {rc=0} 00:51:04.485252 --- ParallelTerminationStrategy: PID 4814 died... 00:51:04.504750 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4814): Terminated: ok {rc=0} 00:51:04.592379 bus /sierra_3: Setting Powered False 00:51:05.690870 bus /sierra_3: Setting Powered False 00:51:06.805905 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 00:51:08.045614 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:51:08.053540 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 00:51:08.074405 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 00:51:08.101302 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 00:51:08.150771 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 00:51:08.170905 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 00:51:08.196800 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 00:51:08.748901 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 00:51:08.797507 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:08.808349 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:51:08.862912 tst mo_mt_call.py: using LAC 24839 00:51:08.983457 tst mo_mt_call.py: using RAC 104 00:51:09.099207 tst mo_mt_call.py: using CellId 24839 00:51:09.217104 tst mo_mt_call.py: using BVCI 24840 00:51:09.326857 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:09.337877 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:09.348621 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:09.359646 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:09.370686 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:09.381639 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:51:09.499546 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:51:09.618656 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:51:10.119206 run create_hlr_db(pid=4820): Launched 00:51:10.250972 bus /sierra_2: Setting Powered False 00:51:11.315195 run create_hlr_db(pid=4820): Terminated: ok {rc=0} 00:51:11.762753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4822): Launched 00:51:12.085400 run osmo-hlr_10.42.42.2(pid=4823): Launched 00:51:12.210505 run osmo-stp_10.42.42.5: Starting osmo-stp 00:51:12.766895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4825): Launched 00:51:13.089352 run osmo-stp_10.42.42.5(pid=4826): Launched 00:51:13.213234 run osmo-msc_10.42.42.6: Starting osmo-msc 00:51:13.795574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4828): Launched 00:51:14.118308 run osmo-msc_10.42.42.6(pid=4829): Launched 00:51:14.299583 run osmo-stp_10.42.42.5(pid=4826): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4826)] 00:51:14.435976 run osmo-stp_10.42.42.5(pid=4826): stdout: | (launched: 2022-12-10_00:51:13.030876) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:51:14.572051 run osmo-stp_10.42.42.5(pid=4826): stderr: | 20221210005113224 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005113224 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005113224 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005113225 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005113225 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005113225 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005113225 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:51:14.707420 run osmo-stp_10.42.42.5(pid=4826): stdout: | (launched: 2022-12-10_00:51:13.030876) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:51:14.836496 run osmo-stp_10.42.42.5(pid=4826): stderr: | 20221210005113224 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005113224 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005113224 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005113225 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005113225 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005113225 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005113225 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:51:14.990511 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4826): Process ended prematurely: osmo-stp_10.42.42.5(pid=4826) [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4826)] [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 00:51:15.000087 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 00:51:15.028103 run osmo-hlr_10.42.42.2(pid=4823): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4823)] 00:51:15.078541 run osmo-hlr_10.42.42.2(pid=4823): stdout: | (launched: 2022-12-10_00:51:12.026996) 00:51:15.130504 run osmo-hlr_10.42.42.2(pid=4823): stderr: | 20221210005112226 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005112226 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005112226 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005112226 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005112226 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005112226 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005112325 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005112335 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005112335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005112335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:51:15.203343 run osmo-msc_10.42.42.6(pid=4829): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4829)] 00:51:15.253424 run osmo-msc_10.42.42.6(pid=4829): stdout: | (launched: 2022-12-10_00:51:14.059267) 00:51:15.305145 run osmo-msc_10.42.42.6(pid=4829): stderr: | 20221210005114382 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210005114382 DLGLOBAL DEBUG validating counter group 0x7f53810c6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210005114382 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210005114382 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210005114382 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210005114382 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210005114384 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210005114385 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210005114385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210005114385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:51:15.357233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4822): Terminating (SIGTERM) 00:51:15.398535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4825): Terminating (SIGTERM) 00:51:15.440019 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4828): Terminating (SIGTERM) 00:51:15.482036 --- ParallelTerminationStrategy: PID 4822 died... 00:51:15.501634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4822): Terminated: ok {rc=0} 00:51:15.547587 --- ParallelTerminationStrategy: PID 4825 died... 00:51:15.567158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4825): Terminated: ok {rc=0} 00:51:15.612913 --- ParallelTerminationStrategy: PID 4828 died... 00:51:15.632441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4828): Terminated: ok {rc=0} 00:51:15.719922 bus /sierra_3: Setting Powered False 00:51:16.818145 bus /sierra_3: Setting Powered False 00:51:17.937126 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 00:51:19.083610 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:19.095100 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:51:19.151231 tst mo_mt_call_osmux.py: using LAC 24840 00:51:19.269412 tst mo_mt_call_osmux.py: using RAC 105 00:51:19.396659 tst mo_mt_call_osmux.py: using CellId 24840 00:51:19.523905 tst mo_mt_call_osmux.py: using BVCI 24841 00:51:19.641488 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:19.653068 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:19.664410 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:19.675921 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:19.687349 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:19.698746 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:51:19.814875 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:51:19.932310 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:51:20.395014 run create_hlr_db(pid=4831): Launched 00:51:20.511335 bus /sierra_2: Setting Powered False 00:51:21.570981 run create_hlr_db(pid=4831): Terminated: ok {rc=0} 00:51:22.009606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4833): Launched 00:51:22.333019 run osmo-hlr_10.42.42.2(pid=4834): Launched 00:51:22.456556 run osmo-stp_10.42.42.5: Starting osmo-stp 00:51:23.016225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4836): Launched 00:51:23.338773 run osmo-stp_10.42.42.5(pid=4837): Launched 00:51:23.462026 run osmo-msc_10.42.42.6: Starting osmo-msc 00:51:24.043907 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4839): Launched 00:51:24.366491 run osmo-msc_10.42.42.6(pid=4840): Launched 00:51:24.546933 run osmo-stp_10.42.42.5(pid=4837): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4837)] 00:51:24.683913 run osmo-stp_10.42.42.5(pid=4837): stdout: | (launched: 2022-12-10_00:51:23.279908) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:51:24.820752 run osmo-stp_10.42.42.5(pid=4837): stderr: | 20221210005123473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005123473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005123474 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005123474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005123475 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005123475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005123475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:51:24.955993 run osmo-stp_10.42.42.5(pid=4837): stdout: | (launched: 2022-12-10_00:51:23.279908) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:51:25.084716 run osmo-stp_10.42.42.5(pid=4837): stderr: | 20221210005123473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005123473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005123474 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005123474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005123475 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005123475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005123475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:51:25.238378 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4837): Process ended prematurely: osmo-stp_10.42.42.5(pid=4837) [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4837)] [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 00:51:25.247950 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 00:51:25.276421 run osmo-hlr_10.42.42.2(pid=4834): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4834)] 00:51:25.326721 run osmo-hlr_10.42.42.2(pid=4834): stdout: | (launched: 2022-12-10_00:51:22.274119) 00:51:25.378825 run osmo-hlr_10.42.42.2(pid=4834): stderr: | 20221210005122474 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005122474 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005122474 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005122474 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005122475 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005122475 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005122487 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005122497 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005122497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005122497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:51:25.450806 run osmo-msc_10.42.42.6(pid=4840): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4840)] 00:51:25.501094 run osmo-msc_10.42.42.6(pid=4840): stdout: | (launched: 2022-12-10_00:51:24.307177) 00:51:25.552644 run osmo-msc_10.42.42.6(pid=4840): stderr: | 20221210005124628 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210005124628 DLGLOBAL DEBUG validating counter group 0x7f8f4c169c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210005124628 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210005124628 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210005124628 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210005124628 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210005124630 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210005124630 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210005124631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210005124631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:51:25.604722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4833): Terminating (SIGTERM) 00:51:25.646286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4836): Terminating (SIGTERM) 00:51:25.688039 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4839): Terminating (SIGTERM) 00:51:25.729934 --- ParallelTerminationStrategy: PID 4833 died... 00:51:25.749653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4833): Terminated: ok {rc=0} 00:51:25.795472 --- ParallelTerminationStrategy: PID 4836 died... 00:51:25.814802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4836): Terminated: ok {rc=0} 00:51:25.860198 --- ParallelTerminationStrategy: PID 4839 died... 00:51:25.879673 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4839): Terminated: ok {rc=0} 00:51:25.965957 bus /sierra_3: Setting Powered False 00:51:27.064377 bus /sierra_3: Setting Powered False 00:51:28.180211 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 00:51:29.410493 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:51:29.416651 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 00:51:29.437495 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 00:51:29.463966 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 00:51:29.513160 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 00:51:29.533536 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 00:51:29.560164 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 00:51:30.114584 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 00:51:30.165128 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:51:30.176298 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:51:30.229992 tst mo_mt_call.py: using LAC 24841 00:51:30.347633 tst mo_mt_call.py: using RAC 106 00:51:30.463988 tst mo_mt_call.py: using CellId 24841 00:51:30.580645 tst mo_mt_call.py: using BVCI 24842 00:51:30.689586 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:51:30.700576 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:51:30.711370 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:51:30.722288 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:51:30.733514 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:51:30.744127 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:51:30.876317 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:51:31.000340 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:51:31.479199 run create_hlr_db(pid=4845): Launched 00:51:31.641713 bus /sierra_2: Setting Powered False 00:51:32.702221 run create_hlr_db(pid=4845): Terminated: ok {rc=0} 00:51:33.142326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4847): Launched 00:51:33.466290 run osmo-hlr_10.42.42.2(pid=4848): Launched 00:51:33.590682 run osmo-stp_10.42.42.5: Starting osmo-stp 00:51:34.144319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4850): Launched 00:51:34.466365 run osmo-stp_10.42.42.5(pid=4851): Launched 00:51:34.591127 run osmo-msc_10.42.42.6: Starting osmo-msc 00:51:35.175626 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4853): Launched 00:51:35.499952 run osmo-msc_10.42.42.6(pid=4854): Launched 00:51:35.681651 run osmo-stp_10.42.42.5(pid=4851): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4851)] 00:51:35.818270 run osmo-stp_10.42.42.5(pid=4851): stdout: | (launched: 2022-12-10_00:51:34.407584) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:51:35.954974 run osmo-stp_10.42.42.5(pid=4851): stderr: | 20221210005134601 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005134601 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005134601 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005134602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005134602 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005134602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005134602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:51:36.091477 run osmo-stp_10.42.42.5(pid=4851): stdout: | (launched: 2022-12-10_00:51:34.407584) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:51:36.220090 run osmo-stp_10.42.42.5(pid=4851): stderr: | 20221210005134601 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005134601 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005134601 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005134602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005134602 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005134602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005134602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:51:36.374323 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4851): Process ended prematurely: osmo-stp_10.42.42.5(pid=4851) [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4851)] [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 00:51:36.383795 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 00:51:36.411486 run osmo-hlr_10.42.42.2(pid=4848): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4848)] 00:51:36.461418 run osmo-hlr_10.42.42.2(pid=4848): stdout: | (launched: 2022-12-10_00:51:33.407650) 00:51:36.513180 run osmo-hlr_10.42.42.2(pid=4848): stderr: | 20221210005133607 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005133607 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005133607 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005133607 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005133607 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005133607 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005133619 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005133628 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005133628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005133628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:51:36.584651 run osmo-msc_10.42.42.6(pid=4854): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4854)] 00:51:36.634241 run osmo-msc_10.42.42.6(pid=4854): stdout: | (launched: 2022-12-10_00:51:35.441119) 00:51:36.685590 run osmo-msc_10.42.42.6(pid=4854): stderr: | 20221210005135763 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210005135763 DLGLOBAL DEBUG validating counter group 0x7fe67b717c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210005135763 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210005135763 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210005135763 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210005135764 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210005135766 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210005135767 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210005135767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210005135767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:51:36.737388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4847): Terminating (SIGTERM) 00:51:36.778583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4850): Terminating (SIGTERM) 00:51:36.820157 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4853): Terminating (SIGTERM) 00:51:36.861821 --- ParallelTerminationStrategy: PID 4847 died... 00:51:36.881651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4847): Terminated: ok {rc=0} 00:51:36.927358 --- ParallelTerminationStrategy: PID 4850 died... 00:51:36.946821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4850): Terminated: ok {rc=0} 00:51:36.992780 --- ParallelTerminationStrategy: PID 4853 died... 00:51:37.012691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4853): Terminated: ok {rc=0} 00:51:37.101052 bus /sierra_3: Setting Powered False 00:51:38.200416 bus /sierra_3: Setting Powered False 00:51:39.317214 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 00:51:40.466567 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:51:40.478802 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:51:40.537371 tst mo_mt_call_osmux.py: using LAC 24842 00:51:40.664893 tst mo_mt_call_osmux.py: using RAC 107 00:51:40.791000 tst mo_mt_call_osmux.py: using CellId 24842 00:51:40.917951 tst mo_mt_call_osmux.py: using BVCI 24843 00:51:41.036271 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:51:41.047794 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:51:41.059186 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:51:41.070494 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:51:41.081727 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:51:41.092926 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:51:41.213471 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:51:41.332560 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:51:41.834582 run create_hlr_db(pid=4856): Launched 00:51:41.966252 bus /sierra_2: Setting Powered False 00:51:43.030194 run create_hlr_db(pid=4856): Terminated: ok {rc=0} 00:51:43.478251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4858): Launched 00:51:43.801088 run osmo-hlr_10.42.42.2(pid=4859): Launched 00:51:43.924624 run osmo-stp_10.42.42.5: Starting osmo-stp 00:51:44.479049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4861): Launched 00:51:44.801836 run osmo-stp_10.42.42.5(pid=4862): Launched 00:51:44.926716 run osmo-msc_10.42.42.6: Starting osmo-msc 00:51:45.511277 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4864): Launched 00:51:45.835403 run osmo-msc_10.42.42.6(pid=4865): Launched 00:51:46.193093 run osmo-stp_10.42.42.5(pid=4862): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4862)] 00:51:46.426729 run osmo-stp_10.42.42.5(pid=4862): stdout: | (launched: 2022-12-10_00:51:44.742870) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:51:46.657893 run osmo-stp_10.42.42.5(pid=4862): stderr: | 20221210005144938 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005144939 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005144939 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005144939 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005144940 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005144940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005144940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:51:46.794003 run osmo-stp_10.42.42.5(pid=4862): stdout: | (launched: 2022-12-10_00:51:44.742870) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:51:46.917574 run osmo-stp_10.42.42.5(pid=4862): stderr: | 20221210005144938 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005144939 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005144939 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005144939 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005144940 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005144940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005144940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:51:47.067366 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4862): Process ended prematurely: osmo-stp_10.42.42.5(pid=4862) [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4862)] [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 00:51:47.077386 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 00:51:47.107472 run osmo-hlr_10.42.42.2(pid=4859): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4859)] 00:51:47.158345 run osmo-hlr_10.42.42.2(pid=4859): stdout: | (launched: 2022-12-10_00:51:43.742015) 00:51:47.211698 run osmo-hlr_10.42.42.2(pid=4859): stderr: | 20221210005143941 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005143942 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005143942 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005143942 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005143942 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005143942 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005143958 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005143968 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005143970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005143970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:51:47.283869 run osmo-msc_10.42.42.6(pid=4865): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4865)] 00:51:47.334749 run osmo-msc_10.42.42.6(pid=4865): stdout: | (launched: 2022-12-10_00:51:45.774897) 00:51:47.387879 run osmo-msc_10.42.42.6(pid=4865): stderr: | 20221210005146231 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210005146231 DLGLOBAL DEBUG validating counter group 0x7f9e9058dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210005146231 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210005146234 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210005146234 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210005146235 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210005146244 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210005146247 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210005146247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210005146248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:51:47.441431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4858): Terminating (SIGTERM) 00:51:47.483882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4861): Terminating (SIGTERM) 00:51:47.525836 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4864): Terminating (SIGTERM) 00:51:47.567888 --- ParallelTerminationStrategy: PID 4858 died... 00:51:47.588163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4858): Terminated: ok {rc=0} 00:51:47.634619 --- ParallelTerminationStrategy: PID 4861 died... 00:51:47.654310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4861): Terminated: ok {rc=0} 00:51:47.700518 --- ParallelTerminationStrategy: PID 4864 died... 00:51:47.720227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4864): Terminated: ok {rc=0} 00:51:47.808391 bus /sierra_3: Setting Powered False 00:51:48.906397 bus /sierra_3: Setting Powered False 00:51:50.021818 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 00:51:51.257395 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:51:51.264402 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 00:51:51.285314 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 00:51:51.312248 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 00:51:51.366390 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 00:51:51.387921 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 00:51:51.414282 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 00:51:51.963467 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 00:51:52.016235 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:51:52.027788 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 00:51:52.085032 tst mo_mt_call.py: using LAC 24843 00:51:52.211766 tst mo_mt_call.py: using RAC 108 00:51:52.340818 tst mo_mt_call.py: using CellId 24843 00:51:52.470472 tst mo_mt_call.py: using BVCI 24844 00:51:52.588197 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:51:52.599645 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:51:52.610840 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:51:52.622002 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:51:52.633167 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:51:52.644305 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:51:52.759299 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:51:52.880673 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:51:53.379761 run create_hlr_db(pid=4870): Launched 00:51:53.511948 bus /sierra_2: Setting Powered False 00:51:54.575300 run create_hlr_db(pid=4870): Terminated: ok {rc=0} 00:51:55.002541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4872): Launched 00:51:55.302884 run osmo-hlr_10.42.42.2(pid=4873): Launched 00:51:55.418947 run osmo-stp_10.42.42.5: Starting osmo-stp 00:51:55.948133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4875): Launched 00:51:56.248198 run osmo-stp_10.42.42.5(pid=4876): Launched 00:51:56.363512 run osmo-msc_10.42.42.6: Starting osmo-msc 00:51:56.905471 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4878): Launched 00:51:57.207682 run osmo-msc_10.42.42.6(pid=4879): Launched 00:51:57.376630 run osmo-stp_10.42.42.5(pid=4876): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4876)] 00:51:57.505804 run osmo-stp_10.42.42.5(pid=4876): stdout: | (launched: 2022-12-10_00:51:56.193307) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:51:57.634101 run osmo-stp_10.42.42.5(pid=4876): stderr: | 20221210005156363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005156363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005156364 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005156364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005156365 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005156365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005156365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:51:57.758892 run osmo-stp_10.42.42.5(pid=4876): stdout: | (launched: 2022-12-10_00:51:56.193307) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:51:57.878856 run osmo-stp_10.42.42.5(pid=4876): stderr: | 20221210005156363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005156363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005156364 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005156364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005156365 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005156365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005156365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:51:58.022089 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4876): Process ended prematurely: osmo-stp_10.42.42.5(pid=4876) [trial-2367↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4876)] [trial-2367↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 00:51:58.031032 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 00:51:58.057947 run osmo-hlr_10.42.42.2(pid=4873): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4873)] 00:51:58.106428 run osmo-hlr_10.42.42.2(pid=4873): stdout: | (launched: 2022-12-10_00:51:55.248265) 00:51:58.156231 run osmo-hlr_10.42.42.2(pid=4873): stderr: | 20221210005155422 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005155422 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005155422 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005155422 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005155422 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005155423 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005155435 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005155446 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005155446 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005155446 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:51:58.225672 run osmo-msc_10.42.42.6(pid=4879): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4879)] 00:51:58.273535 run osmo-msc_10.42.42.6(pid=4879): stdout: | (launched: 2022-12-10_00:51:57.152146) 00:51:58.323123 run osmo-msc_10.42.42.6(pid=4879): stderr: | 20221210005157424 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210005157424 DLGLOBAL DEBUG validating counter group 0x7f21f3193c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210005157424 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210005157424 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210005157424 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210005157424 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210005157426 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210005157427 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210005157427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210005157427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:51:58.373170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4872): Terminating (SIGTERM) 00:51:58.412756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4875): Terminating (SIGTERM) 00:51:58.452564 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4878): Terminating (SIGTERM) 00:51:58.492557 --- ParallelTerminationStrategy: PID 4872 died... 00:51:58.511305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4872): Terminated: ok {rc=0} 00:51:58.555645 --- ParallelTerminationStrategy: PID 4875 died... 00:51:58.574315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4875): Terminated: ok {rc=0} 00:51:58.618454 --- ParallelTerminationStrategy: PID 4878 died... 00:51:58.637111 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4878): Terminated: ok {rc=0} 00:51:58.723213 bus /sierra_3: Setting Powered False 00:51:59.822883 bus /sierra_3: Setting Powered False 00:52:00.950663 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 00:52:02.112083 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:52:02.124716 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 00:52:02.187754 tst mo_mt_call_osmux.py: using LAC 24844 00:52:02.318732 tst mo_mt_call_osmux.py: using RAC 109 00:52:02.445313 tst mo_mt_call_osmux.py: using CellId 24844 00:52:02.570161 tst mo_mt_call_osmux.py: using BVCI 24845 00:52:02.687011 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:52:02.698720 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:52:02.710036 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:52:02.721482 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:52:02.732902 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:52:02.744333 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:52:02.863267 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:52:02.980004 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:52:03.446011 run create_hlr_db(pid=4881): Launched 00:52:03.561570 bus /sierra_2: Setting Powered False 00:52:04.621760 run create_hlr_db(pid=4881): Terminated: ok {rc=0} 00:52:05.063399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4883): Launched 00:52:05.387428 run osmo-hlr_10.42.42.2(pid=4884): Launched 00:52:05.511106 run osmo-stp_10.42.42.5: Starting osmo-stp 00:52:06.066758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4886): Launched 00:52:06.387853 run osmo-stp_10.42.42.5(pid=4887): Launched 00:52:06.510706 run osmo-msc_10.42.42.6: Starting osmo-msc 00:52:07.094223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4889): Launched 00:52:07.416090 run osmo-msc_10.42.42.6(pid=4890): Launched 00:52:07.596448 run osmo-stp_10.42.42.5(pid=4887): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4887)] 00:52:07.732688 run osmo-stp_10.42.42.5(pid=4887): stdout: | (launched: 2022-12-10_00:52:06.329344) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:52:07.868699 run osmo-stp_10.42.42.5(pid=4887): stderr: | 20221210005206523 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005206523 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005206523 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005206524 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005206524 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005206524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005206524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:52:08.003449 run osmo-stp_10.42.42.5(pid=4887): stdout: | (launched: 2022-12-10_00:52:06.329344) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:52:08.131175 run osmo-stp_10.42.42.5(pid=4887): stderr: | 20221210005206523 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005206523 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005206523 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005206524 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005206524 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005206524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005206524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:52:08.284338 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4887): Process ended prematurely: osmo-stp_10.42.42.5(pid=4887) [trial-2367↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4887)] [trial-2367↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 00:52:08.294023 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 00:52:08.321762 run osmo-hlr_10.42.42.2(pid=4884): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4884)] 00:52:08.371496 run osmo-hlr_10.42.42.2(pid=4884): stdout: | (launched: 2022-12-10_00:52:05.328671) 00:52:08.422734 run osmo-hlr_10.42.42.2(pid=4884): stderr: | 20221210005205527 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005205527 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005205527 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005205527 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005205527 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005205527 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005205540 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005205550 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005205550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005205550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:52:08.494302 run osmo-msc_10.42.42.6(pid=4890): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4890)] 00:52:08.543627 run osmo-msc_10.42.42.6(pid=4890): stdout: | (launched: 2022-12-10_00:52:07.357495) 00:52:08.594834 run osmo-msc_10.42.42.6(pid=4890): stderr: | 20221210005207681 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210005207681 DLGLOBAL DEBUG validating counter group 0x7f5c58290c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210005207682 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210005207682 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210005207682 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210005207682 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210005207686 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210005207686 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210005207686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210005207686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:52:08.646229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4883): Terminating (SIGTERM) 00:52:08.687472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4886): Terminating (SIGTERM) 00:52:08.728796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4889): Terminating (SIGTERM) 00:52:08.770961 --- ParallelTerminationStrategy: PID 4883 died... 00:52:08.790889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4883): Terminated: ok {rc=0} 00:52:08.837132 --- ParallelTerminationStrategy: PID 4886 died... 00:52:08.856672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4886): Terminated: ok {rc=0} 00:52:08.902374 --- ParallelTerminationStrategy: PID 4889 died... 00:52:08.921757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4889): Terminated: ok {rc=0} 00:52:09.008467 bus /sierra_3: Setting Powered False 00:52:10.105576 bus /sierra_3: Setting Powered False 00:52:11.221702 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 00:52:12.457726 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:52:12.464434 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 00:52:12.485942 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 00:52:12.512712 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 00:52:12.562250 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 00:52:12.582320 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 00:52:12.608172 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 00:52:13.159836 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 00:52:13.208654 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:13.219560 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 00:52:13.278296 tst mo_mt_call.py: using LAC 24845 00:52:13.395311 tst mo_mt_call.py: using RAC 110 00:52:13.511583 tst mo_mt_call.py: using CellId 24845 00:52:13.627947 tst mo_mt_call.py: using BVCI 24846 00:52:13.736468 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:13.747459 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:13.758082 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:13.769038 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:13.780125 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:13.791062 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:52:13.906552 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:52:14.025995 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:52:14.492906 run create_hlr_db(pid=4896): Launched 00:52:14.609370 bus /sierra_2: Setting Powered False 00:52:15.669905 run create_hlr_db(pid=4896): Terminated: ok {rc=0} 00:52:16.142707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4898): Launched 00:52:16.480605 run osmo-hlr_10.42.42.2(pid=4899): Launched 00:52:16.643252 run osmo-stp_10.42.42.5: Starting osmo-stp 00:52:17.371312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4901): Launched 00:52:17.695057 run osmo-stp_10.42.42.5(pid=4902): Launched 00:52:17.819836 run osmo-msc_10.42.42.6: Starting osmo-msc 00:52:18.406765 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4904): Launched 00:52:18.730149 run osmo-msc_10.42.42.6(pid=4905): Launched 00:52:18.911474 run osmo-stp_10.42.42.5(pid=4902): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4902)] 00:52:19.047747 run osmo-stp_10.42.42.5(pid=4902): stdout: | (launched: 2022-12-10_00:52:17.635805) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:52:19.184061 run osmo-stp_10.42.42.5(pid=4902): stderr: | 20221210005217828 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005217828 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005217828 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005217829 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005217829 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005217829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005217829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:52:19.319399 run osmo-stp_10.42.42.5(pid=4902): stdout: | (launched: 2022-12-10_00:52:17.635805) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:52:19.447852 run osmo-stp_10.42.42.5(pid=4902): stderr: | 20221210005217828 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005217828 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005217828 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005217829 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005217829 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005217829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005217829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:52:19.602110 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4902): Process ended prematurely: osmo-stp_10.42.42.5(pid=4902) [trial-2367↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4902)] [trial-2367↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 00:52:19.611684 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 00:52:19.639720 run osmo-hlr_10.42.42.2(pid=4899): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4899)] 00:52:19.690419 run osmo-hlr_10.42.42.2(pid=4899): stdout: | (launched: 2022-12-10_00:52:16.420463) 00:52:19.742670 run osmo-hlr_10.42.42.2(pid=4899): stderr: | 20221210005216760 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005216760 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005216760 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005216760 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005216760 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005216760 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005216783 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005216800 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005216800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005216800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:52:19.815658 run osmo-msc_10.42.42.6(pid=4905): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4905)] 00:52:19.866276 run osmo-msc_10.42.42.6(pid=4905): stdout: | (launched: 2022-12-10_00:52:18.671358) 00:52:19.917920 run osmo-msc_10.42.42.6(pid=4905): stderr: | 20221210005218995 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210005218996 DLGLOBAL DEBUG validating counter group 0x7f85c6d61c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210005218996 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210005218996 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210005218996 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210005218996 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210005218998 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210005218998 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210005218998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210005218998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:52:19.969975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4898): Terminating (SIGTERM) 00:52:20.011839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4901): Terminating (SIGTERM) 00:52:20.053857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4904): Terminating (SIGTERM) 00:52:20.096082 --- ParallelTerminationStrategy: PID 4898 died... 00:52:20.116324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4898): Terminated: ok {rc=0} 00:52:20.162738 --- ParallelTerminationStrategy: PID 4901 died... 00:52:20.182473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4901): Terminated: ok {rc=0} 00:52:20.228670 --- ParallelTerminationStrategy: PID 4904 died... 00:52:20.248173 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4904): Terminated: ok {rc=0} 00:52:20.336089 bus /sierra_3: Setting Powered False 00:52:21.438220 bus /sierra_3: Setting Powered False 00:52:22.554741 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 00:52:23.705736 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:23.717909 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 00:52:23.776484 tst mo_mt_call_osmux.py: using LAC 24846 00:52:23.895689 tst mo_mt_call_osmux.py: using RAC 111 00:52:24.017231 tst mo_mt_call_osmux.py: using CellId 24846 00:52:24.136855 tst mo_mt_call_osmux.py: using BVCI 24847 00:52:24.245817 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:24.256855 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:24.267605 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:24.278591 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:24.289566 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:24.300472 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:52:24.419775 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:52:24.535300 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:52:25.005397 run create_hlr_db(pid=4907): Launched 00:52:25.121140 bus /sierra_2: Setting Powered False 00:52:26.181229 run create_hlr_db(pid=4907): Terminated: ok {rc=0} 00:52:26.619852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4909): Launched 00:52:26.942565 run osmo-hlr_10.42.42.2(pid=4910): Launched 00:52:27.067047 run osmo-stp_10.42.42.5: Starting osmo-stp 00:52:27.626392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4912): Launched 00:52:27.949438 run osmo-stp_10.42.42.5(pid=4913): Launched 00:52:28.073941 run osmo-msc_10.42.42.6: Starting osmo-msc 00:52:28.657425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4915): Launched 00:52:28.981115 run osmo-msc_10.42.42.6(pid=4916): Launched 00:52:29.160839 run osmo-stp_10.42.42.5(pid=4913): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4913)] 00:52:29.295976 run osmo-stp_10.42.42.5(pid=4913): stdout: | (launched: 2022-12-10_00:52:27.890496) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:52:29.431611 run osmo-stp_10.42.42.5(pid=4913): stderr: | 20221210005228083 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005228083 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005228083 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005228084 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005228084 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005228084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005228084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:52:29.567025 run osmo-stp_10.42.42.5(pid=4913): stdout: | (launched: 2022-12-10_00:52:27.890496) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:52:29.695042 run osmo-stp_10.42.42.5(pid=4913): stderr: | 20221210005228083 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005228083 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005228083 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005228084 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005228084 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005228084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005228084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:52:29.849399 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4913): Process ended prematurely: osmo-stp_10.42.42.5(pid=4913) [trial-2367↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4913)] [trial-2367↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 00:52:29.858743 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 00:52:29.886989 run osmo-hlr_10.42.42.2(pid=4910): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4910)] 00:52:29.936800 run osmo-hlr_10.42.42.2(pid=4910): stdout: | (launched: 2022-12-10_00:52:26.883707) 00:52:29.988309 run osmo-hlr_10.42.42.2(pid=4910): stderr: | 20221210005227084 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005227084 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005227084 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005227084 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005227084 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005227084 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005227097 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005227105 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005227105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005227105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:52:30.060205 run osmo-msc_10.42.42.6(pid=4916): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4916)] 00:52:30.110117 run osmo-msc_10.42.42.6(pid=4916): stdout: | (launched: 2022-12-10_00:52:28.922113) 00:52:30.161552 run osmo-msc_10.42.42.6(pid=4916): stderr: | 20221210005229245 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210005229245 DLGLOBAL DEBUG validating counter group 0x7feb5830fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210005229245 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210005229245 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210005229245 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210005229245 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210005229247 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210005229247 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210005229248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210005229248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:52:30.213938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4909): Terminating (SIGTERM) 00:52:30.255518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4912): Terminating (SIGTERM) 00:52:30.297023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4915): Terminating (SIGTERM) 00:52:30.338929 --- ParallelTerminationStrategy: PID 4909 died... 00:52:30.358675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4909): Terminated: ok {rc=0} 00:52:30.404820 --- ParallelTerminationStrategy: PID 4912 died... 00:52:30.424439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4912): Terminated: ok {rc=0} 00:52:30.470311 --- ParallelTerminationStrategy: PID 4915 died... 00:52:30.489824 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4915): Terminated: ok {rc=0} 00:52:30.576541 bus /sierra_3: Setting Powered False 00:52:31.673188 bus /sierra_3: Setting Powered False 00:52:32.787218 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 00:52:34.026205 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:52:34.033225 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 00:52:34.054510 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 00:52:34.081276 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 00:52:34.135368 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 00:52:34.156422 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 00:52:34.183030 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 00:52:34.733937 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 00:52:34.784918 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:52:34.796159 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:52:34.852677 tst mo_mt_call.py: using LAC 24847 00:52:34.972419 tst mo_mt_call.py: using RAC 112 00:52:35.091453 tst mo_mt_call.py: using CellId 24847 00:52:35.210213 tst mo_mt_call.py: using BVCI 24848 00:52:35.318829 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:52:35.330119 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:52:35.340811 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:52:35.351979 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:52:35.363168 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:52:35.374408 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:52:35.492169 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:52:35.607155 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:52:36.076632 run create_hlr_db(pid=4924): Launched 00:52:36.191844 bus /sierra_2: Setting Powered False 00:52:37.252364 run create_hlr_db(pid=4924): Terminated: ok {rc=0} 00:52:37.691751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4926): Launched 00:52:38.016464 run osmo-hlr_10.42.42.2(pid=4927): Launched 00:52:38.140879 run osmo-stp_10.42.42.5: Starting osmo-stp 00:52:38.700146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4929): Launched 00:52:39.022216 run osmo-stp_10.42.42.5(pid=4930): Launched 00:52:39.145483 run osmo-msc_10.42.42.6: Starting osmo-msc 00:52:39.727130 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4932): Launched 00:52:40.050114 run osmo-msc_10.42.42.6(pid=4933): Launched 00:52:40.231010 run osmo-stp_10.42.42.5(pid=4930): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4930)] 00:52:40.366707 run osmo-stp_10.42.42.5(pid=4930): stdout: | (launched: 2022-12-10_00:52:38.963707) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:52:40.502472 run osmo-stp_10.42.42.5(pid=4930): stderr: | 20221210005239154 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005239154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005239154 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005239155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005239157 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005239157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005239157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:52:40.637932 run osmo-stp_10.42.42.5(pid=4930): stdout: | (launched: 2022-12-10_00:52:38.963707) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:52:40.766200 run osmo-stp_10.42.42.5(pid=4930): stderr: | 20221210005239154 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005239154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005239154 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005239155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005239157 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005239157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005239157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:52:40.920117 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4930): Process ended prematurely: osmo-stp_10.42.42.5(pid=4930) [trial-2367↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4930)] [trial-2367↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 00:52:40.929560 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 00:52:40.957346 run osmo-hlr_10.42.42.2(pid=4927): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4927)] 00:52:41.007100 run osmo-hlr_10.42.42.2(pid=4927): stdout: | (launched: 2022-12-10_00:52:37.957964) 00:52:41.058590 run osmo-hlr_10.42.42.2(pid=4927): stderr: | 20221210005238154 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005238154 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005238154 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005238154 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005238154 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005238154 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005238167 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005238176 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005238176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005238176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:52:41.130111 run osmo-msc_10.42.42.6(pid=4933): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4933)] 00:52:41.180055 run osmo-msc_10.42.42.6(pid=4933): stdout: | (launched: 2022-12-10_00:52:39.991573) 00:52:41.231052 run osmo-msc_10.42.42.6(pid=4933): stderr: | 20221210005240313 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210005240313 DLGLOBAL DEBUG validating counter group 0x7effbf7cdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210005240314 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210005240314 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210005240314 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210005240314 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210005240316 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210005240316 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210005240316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210005240316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:52:41.282649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4926): Terminating (SIGTERM) 00:52:41.323909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4929): Terminating (SIGTERM) 00:52:41.365337 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4932): Terminating (SIGTERM) 00:52:41.406897 --- ParallelTerminationStrategy: PID 4926 died... 00:52:41.426533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4926): Terminated: ok {rc=0} 00:52:41.472453 --- ParallelTerminationStrategy: PID 4929 died... 00:52:41.491966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4929): Terminated: ok {rc=0} 00:52:41.538052 --- ParallelTerminationStrategy: PID 4932 died... 00:52:41.557537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4932): Terminated: ok {rc=0} 00:52:41.645487 bus /sierra_3: Setting Powered False 00:52:42.743161 bus /sierra_3: Setting Powered False 00:52:43.860317 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 00:52:45.009278 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:52:45.021561 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:52:45.080217 tst mo_mt_call_osmux.py: using LAC 24848 00:52:45.208368 tst mo_mt_call_osmux.py: using RAC 113 00:52:45.335923 tst mo_mt_call_osmux.py: using CellId 24848 00:52:45.466846 tst mo_mt_call_osmux.py: using BVCI 24849 00:52:45.577543 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:52:45.588729 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:52:45.599841 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:52:45.611180 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:52:45.622519 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:52:45.633838 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:52:45.752255 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:52:45.884373 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:52:46.455054 run create_hlr_db(pid=4935): Launched 00:52:46.634811 bus /sierra_2: Setting Powered False 00:52:47.699138 run create_hlr_db(pid=4935): Terminated: ok {rc=0} 00:52:48.128635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4937): Launched 00:52:48.429665 run osmo-hlr_10.42.42.2(pid=4938): Launched 00:52:48.545406 run osmo-stp_10.42.42.5: Starting osmo-stp 00:52:49.076888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4940): Launched 00:52:49.378885 run osmo-stp_10.42.42.5(pid=4941): Launched 00:52:49.494593 run osmo-msc_10.42.42.6: Starting osmo-msc 00:52:50.038235 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4943): Launched 00:52:50.339729 run osmo-msc_10.42.42.6(pid=4944): Launched 00:52:50.508475 run osmo-stp_10.42.42.5(pid=4941): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4941)] 00:52:50.635209 run osmo-stp_10.42.42.5(pid=4941): stdout: | (launched: 2022-12-10_00:52:49.322955) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:52:50.761956 run osmo-stp_10.42.42.5(pid=4941): stderr: | 20221210005249493 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005249494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005249494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005249494 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005249495 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005249495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005249495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:52:50.887514 run osmo-stp_10.42.42.5(pid=4941): stdout: | (launched: 2022-12-10_00:52:49.322955) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:52:51.007206 run osmo-stp_10.42.42.5(pid=4941): stderr: | 20221210005249493 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005249494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005249494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005249494 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005249495 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005249495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005249495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:52:51.150664 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4941): Process ended prematurely: osmo-stp_10.42.42.5(pid=4941) [trial-2367↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4941)] [trial-2367↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 00:52:51.159348 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 00:52:51.186554 run osmo-hlr_10.42.42.2(pid=4938): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4938)] 00:52:51.234468 run osmo-hlr_10.42.42.2(pid=4938): stdout: | (launched: 2022-12-10_00:52:48.374284) 00:52:51.284103 run osmo-hlr_10.42.42.2(pid=4938): stderr: | 20221210005248552 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005248552 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005248552 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005248552 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005248552 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005248552 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005248564 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005248574 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005248574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005248574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:52:51.353495 run osmo-msc_10.42.42.6(pid=4944): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4944)] 00:52:51.401546 run osmo-msc_10.42.42.6(pid=4944): stdout: | (launched: 2022-12-10_00:52:50.284401) 00:52:51.451232 run osmo-msc_10.42.42.6(pid=4944): stderr: | 20221210005250561 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210005250561 DLGLOBAL DEBUG validating counter group 0x7f4552078c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210005250561 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210005250561 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210005250562 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210005250562 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210005250563 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210005250564 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210005250564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210005250564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:52:51.501384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4937): Terminating (SIGTERM) 00:52:51.541266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4940): Terminating (SIGTERM) 00:52:51.581316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4943): Terminating (SIGTERM) 00:52:51.621917 --- ParallelTerminationStrategy: PID 4937 died... 00:52:51.641449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4937): Terminated: ok {rc=0} 00:52:51.685674 --- ParallelTerminationStrategy: PID 4940 died... 00:52:51.704254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4940): Terminated: ok {rc=0} 00:52:51.748402 --- ParallelTerminationStrategy: PID 4943 died... 00:52:51.767082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4943): Terminated: ok {rc=0} 00:52:51.853219 bus /sierra_3: Setting Powered False 00:52:52.952387 bus /sierra_3: Setting Powered False 00:52:54.067425 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 00:52:55.302519 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:52:55.308027 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 00:52:55.328711 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 00:52:55.355147 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 00:52:55.404812 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 00:52:55.425036 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 00:52:55.450980 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 00:52:56.001412 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 00:52:56.050314 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:52:56.061147 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:52:56.116082 tst mo_mt_call.py: using LAC 24849 00:52:56.242881 tst mo_mt_call.py: using RAC 114 00:52:56.367925 tst mo_mt_call.py: using CellId 24849 00:52:56.494453 tst mo_mt_call.py: using BVCI 24850 00:52:56.611703 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:52:56.623266 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:52:56.634367 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:52:56.645599 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:52:56.656750 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:52:56.668019 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:52:56.785973 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:52:56.901885 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:52:57.369429 run create_hlr_db(pid=4949): Launched 00:52:57.485488 bus /sierra_2: Setting Powered False 00:52:58.545292 run create_hlr_db(pid=4949): Terminated: ok {rc=0} 00:52:58.986064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4951): Launched 00:52:59.309583 run osmo-hlr_10.42.42.2(pid=4952): Launched 00:52:59.434081 run osmo-stp_10.42.42.5: Starting osmo-stp 00:52:59.991902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4954): Launched 00:53:00.315951 run osmo-stp_10.42.42.5(pid=4955): Launched 00:53:00.439820 run osmo-msc_10.42.42.6: Starting osmo-msc 00:53:01.046605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4957): Launched 00:53:01.381538 run osmo-msc_10.42.42.6(pid=4958): Launched 00:53:01.750851 run osmo-stp_10.42.42.5(pid=4955): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4955)] 00:53:01.923934 run osmo-stp_10.42.42.5(pid=4955): stdout: | (launched: 2022-12-10_00:53:00.256862) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:53:02.065823 run osmo-stp_10.42.42.5(pid=4955): stderr: | 20221210005300451 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005300452 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005300452 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005300452 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005300453 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005300453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005300453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:53:02.292909 run osmo-stp_10.42.42.5(pid=4955): stdout: | (launched: 2022-12-10_00:53:00.256862) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:53:02.467845 run osmo-stp_10.42.42.5(pid=4955): stderr: | 20221210005300451 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005300452 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005300452 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005300452 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005300453 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005300453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005300453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:53:02.621862 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4955): Process ended prematurely: osmo-stp_10.42.42.5(pid=4955) [trial-2367↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4955)] [trial-2367↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 00:53:02.635229 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 00:53:02.666111 run osmo-hlr_10.42.42.2(pid=4952): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4952)] 00:53:02.717299 run osmo-hlr_10.42.42.2(pid=4952): stdout: | (launched: 2022-12-10_00:52:59.250720) 00:53:02.770845 run osmo-hlr_10.42.42.2(pid=4952): stderr: | 20221210005259451 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005259451 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005259451 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005259451 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005259451 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005259451 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005259464 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005259472 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005259472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005259472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:53:02.845840 run osmo-msc_10.42.42.6(pid=4958): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4958)] 00:53:02.897750 run osmo-msc_10.42.42.6(pid=4958): stdout: | (launched: 2022-12-10_00:53:01.320324) 00:53:02.949698 run osmo-msc_10.42.42.6(pid=4958): stderr: | 20221210005301819 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210005301819 DLGLOBAL DEBUG validating counter group 0x7f0789dc8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210005301819 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210005301819 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210005301819 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210005301819 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210005301829 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210005301830 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210005301830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210005301830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:53:03.003607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4951): Terminating (SIGTERM) 00:53:03.048185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4954): Terminating (SIGTERM) 00:53:03.092471 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4957): Terminating (SIGTERM) 00:53:03.137388 --- ParallelTerminationStrategy: PID 4951 died... 00:53:03.157616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4951): Terminated: ok {rc=0} 00:53:03.208005 --- ParallelTerminationStrategy: PID 4954 died... 00:53:03.228269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4954): Terminated: ok {rc=0} 00:53:03.276134 --- ParallelTerminationStrategy: PID 4957 died... 00:53:03.296153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4957): Terminated: ok {rc=0} 00:53:03.386906 bus /sierra_3: Setting Powered False 00:53:04.491064 bus /sierra_3: Setting Powered False 00:53:05.609188 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 00:53:06.759127 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:53:06.771935 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:53:06.832902 tst mo_mt_call_osmux.py: using LAC 24850 00:53:06.954456 tst mo_mt_call_osmux.py: using RAC 115 00:53:07.081163 tst mo_mt_call_osmux.py: using CellId 24850 00:53:07.203622 tst mo_mt_call_osmux.py: using BVCI 24851 00:53:07.315779 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:53:07.327566 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:53:07.339150 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:53:07.351681 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:53:07.365046 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:53:07.378726 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:53:07.496448 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:53:07.616480 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:53:08.124224 run create_hlr_db(pid=4973): Launched 00:53:08.288174 bus /sierra_2: Setting Powered False 00:53:09.354510 run create_hlr_db(pid=4973): Terminated: ok {rc=0} 00:53:09.824811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4975): Launched 00:53:10.175473 run osmo-hlr_10.42.42.2(pid=4976): Launched 00:53:10.432305 run osmo-stp_10.42.42.5: Starting osmo-stp 00:53:11.121162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4978): Launched 00:53:11.469712 run osmo-stp_10.42.42.5(pid=4979): Launched 00:53:11.724059 run osmo-msc_10.42.42.6: Starting osmo-msc 00:53:12.429139 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4981): Launched 00:53:12.777279 run osmo-msc_10.42.42.6(pid=4982): Launched 00:53:13.201711 run osmo-stp_10.42.42.5(pid=4979): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4979)] 00:53:13.498147 run osmo-stp_10.42.42.5(pid=4979): stdout: | (launched: 2022-12-10_00:53:11.409272) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:53:13.731530 run osmo-stp_10.42.42.5(pid=4979): stderr: | 20221210005311712 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005311712 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005311712 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005311712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005311713 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005311713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005311713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:53:13.888493 run osmo-stp_10.42.42.5(pid=4979): stdout: | (launched: 2022-12-10_00:53:11.409272) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:53:14.051783 run osmo-stp_10.42.42.5(pid=4979): stderr: | 20221210005311712 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005311712 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005311712 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005311712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005311713 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005311713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005311713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:53:14.242966 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4979): Process ended prematurely: osmo-stp_10.42.42.5(pid=4979) [trial-2367↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4979)] [trial-2367↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 00:53:14.253785 tst mo_mt_call_osmux.py:8: Test FAILED (7.5 sec) 00:53:14.288091 run osmo-hlr_10.42.42.2(pid=4976): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4976)] 00:53:14.351490 run osmo-hlr_10.42.42.2(pid=4976): stdout: | (launched: 2022-12-10_00:53:10.114688) 00:53:14.419657 run osmo-hlr_10.42.42.2(pid=4976): stderr: | 20221210005310426 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005310426 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005310426 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005310426 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005310426 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005310426 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005310439 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005310453 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005310453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005310453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:53:14.523563 run osmo-msc_10.42.42.6(pid=4982): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4982)] 00:53:14.589178 run osmo-msc_10.42.42.6(pid=4982): stdout: | (launched: 2022-12-10_00:53:12.716424) 00:53:14.651339 run osmo-msc_10.42.42.6(pid=4982): stderr: | 20221210005313243 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210005313243 DLGLOBAL DEBUG validating counter group 0x7f9bc7704c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210005313243 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210005313243 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210005313244 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210005313244 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210005313254 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210005313254 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210005313254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210005313254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:53:14.709150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4975): Terminating (SIGTERM) 00:53:14.766111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4978): Terminating (SIGTERM) 00:53:14.822486 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4981): Terminating (SIGTERM) 00:53:14.877512 --- ParallelTerminationStrategy: PID 4975 died... 00:53:14.905258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4975): Terminated: ok {rc=0} 00:53:14.971005 --- ParallelTerminationStrategy: PID 4978 died... 00:53:14.999796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4978): Terminated: ok {rc=0} 00:53:15.055563 --- ParallelTerminationStrategy: PID 4981 died... 00:53:15.080328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4981): Terminated: ok {rc=0} 00:53:15.197406 bus /sierra_3: Setting Powered False 00:53:16.350980 bus /sierra_3: Setting Powered False 00:53:17.496338 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 emergency:oc2g --------------------------------------------------------------------- 00:53:18.740443 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:53:18.746105 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 00:53:18.768644 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 00:53:18.798549 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 00:53:18.885723 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 00:53:18.908144 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 00:53:18.936474 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 00:53:19.521019 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2367 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 00:53:19.527820 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:53:19.539937 tst emergency:oc2g: Using 1 x bts (candidates: 1) 00:53:19.578383 tst emergency_mo_mt_call.py: using LAC 24851 00:53:19.707574 tst emergency_mo_mt_call.py: using RAC 116 00:53:19.835380 tst emergency_mo_mt_call.py: using CellId 24851 00:53:19.965474 tst emergency_mo_mt_call.py: using BVCI 24852 00:53:20.087955 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:53:20.100417 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:53:20.112594 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:53:20.123957 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:53:20.135357 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:53:20.147187 tst emergency:oc2g: Using 1 x modem (candidates: 4) 00:53:20.272449 tst emergency:oc2g: Using 1 x modem (candidates: 4) 00:53:20.396903 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:53:20.913559 run create_hlr_db(pid=5246): Launched 00:53:21.083924 bus /sierra_2: Setting Powered False 00:53:22.150339 run create_hlr_db(pid=5246): Terminated: ok {rc=0} 00:53:22.614058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5248): Launched 00:53:22.957639 run osmo-hlr_10.42.42.2(pid=5249): Launched 00:53:23.212379 run osmo-stp_10.42.42.5: Starting osmo-stp 00:53:23.886038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5251): Launched 00:53:24.229807 run osmo-stp_10.42.42.5(pid=5252): Launched 00:53:24.492321 tst emergency_mo_mt_call.py: using MSISDN 7469 00:53:24.733890 run osmo-msc_10.42.42.6: Starting osmo-msc 00:53:25.335425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5254): Launched 00:53:25.687642 run osmo-msc_10.42.42.6(pid=5255): Launched 00:53:25.868118 run osmo-stp_10.42.42.5(pid=5252): ERR: Terminated: ERROR {rc=1} [trial-2367↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5252)] 00:53:26.004220 run osmo-stp_10.42.42.5(pid=5252): stdout: | (launched: 2022-12-10_00:53:24.169462) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:53:26.140631 run osmo-stp_10.42.42.5(pid=5252): stderr: | 20221210005324470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005324470 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005324470 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005324471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005324471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005324471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005324471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:53:26.275795 run osmo-stp_10.42.42.5(pid=5252): stdout: | (launched: 2022-12-10_00:53:24.169462) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:53:26.404509 run osmo-stp_10.42.42.5(pid=5252): stderr: | 20221210005324470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005324470 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005324470 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005324471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005324471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005324471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005324471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:53:26.557114 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=5252): Process ended prematurely: osmo-stp_10.42.42.5(pid=5252) [trial-2367↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5252)] [trial-2367↪emergency:oc2g↪emergency_mo_mt_call.py:19] 00:53:26.566200 tst emergency_mo_mt_call.py:19: Test FAILED (7.0 sec) 00:53:26.593890 run osmo-hlr_10.42.42.2(pid=5249): ERR: Terminated: ERROR {rc=237} [trial-2367↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5249)] 00:53:26.643806 run osmo-hlr_10.42.42.2(pid=5249): stdout: | (launched: 2022-12-10_00:53:22.897953) 00:53:26.695426 run osmo-hlr_10.42.42.2(pid=5249): stderr: | 20221210005323210 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005323210 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005323210 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005323210 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005323211 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005323211 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005323231 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005323247 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005323248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005323248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:53:26.767445 run osmo-msc_10.42.42.6(pid=5255): ERR: Terminated: ERROR {rc=2} [trial-2367↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5255)] 00:53:26.817257 run osmo-msc_10.42.42.6(pid=5255): stdout: | (launched: 2022-12-10_00:53:25.628716) 00:53:26.869142 run osmo-msc_10.42.42.6(pid=5255): stderr: | 20221210005325951 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210005325951 DLGLOBAL DEBUG validating counter group 0x7f7a1f853c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210005325951 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210005325951 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210005325951 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210005325951 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210005325953 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210005325954 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210005325954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210005325954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:53:26.921045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5248): Terminating (SIGTERM) 00:53:26.962771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5251): Terminating (SIGTERM) 00:53:27.004586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5254): Terminating (SIGTERM) 00:53:27.046647 --- ParallelTerminationStrategy: PID 5248 died... 00:53:27.066389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5248): Terminated: ok {rc=0} 00:53:27.112402 --- ParallelTerminationStrategy: PID 5251 died... 00:53:27.131944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5251): Terminated: ok {rc=0} 00:53:27.177659 --- ParallelTerminationStrategy: PID 5254 died... 00:53:27.196939 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5254): Terminated: ok {rc=0} 00:53:27.286023 bus /sierra_3: Setting Powered False 00:53:28.384055 bus /sierra_3: Setting Powered False 00:53:29.500689 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 00:53:30.586643 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:53:30.598658 tst emergency:oc2g: Using 1 x bts (candidates: 1) 00:53:30.637084 tst emergency_preemptive_call.py: using LAC 24852 00:53:30.762691 tst emergency_preemptive_call.py: using RAC 117 00:53:30.908934 tst emergency_preemptive_call.py: using CellId 24852 00:53:31.043950 tst emergency_preemptive_call.py: using BVCI 24853 00:53:31.180615 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:53:31.193297 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:53:31.205864 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:53:31.218502 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:53:31.229970 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:53:31.242545 tst emergency:oc2g: Using 1 x modem (candidates: 4) 00:53:31.382426 tst emergency:oc2g: Using 1 x modem (candidates: 4) 00:53:31.526199 tst emergency:oc2g: Using 1 x modem (candidates: 4) 00:53:31.672123 tst emergency:oc2g: Using 1 x modem (candidates: 4) 00:53:31.804174 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:53:32.336541 run create_hlr_db(pid=5257): Launched 00:53:32.457386 bus /sierra_2: Setting Powered False 00:53:33.517506 run create_hlr_db(pid=5257): Terminated: ok {rc=0} 00:53:33.957175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5259): Launched 00:53:34.281889 run osmo-hlr_10.42.42.2(pid=5260): Launched 00:53:34.400257 run osmo-stp_10.42.42.5: Starting osmo-stp 00:53:34.930245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5262): Launched 00:53:35.231313 run osmo-stp_10.42.42.5(pid=5263): Launched 00:53:35.356555 tst emergency_preemptive_call.py: using MSISDN 7470 00:53:35.510162 run osmo-msc_10.42.42.6: Starting osmo-msc 00:53:36.049853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5265): Launched 00:53:36.353408 run osmo-msc_10.42.42.6(pid=5266): Launched 00:53:36.523313 run osmo-stp_10.42.42.5(pid=5263): ERR: Terminated: ERROR {rc=1} [trial-2367↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5263)] 00:53:36.652270 run osmo-stp_10.42.42.5(pid=5263): stdout: | (launched: 2022-12-10_00:53:35.176177) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:53:36.780927 run osmo-stp_10.42.42.5(pid=5263): stderr: | 20221210005335345 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005335346 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005335346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005335346 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005335347 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005335347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005335347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:53:36.907252 run osmo-stp_10.42.42.5(pid=5263): stdout: | (launched: 2022-12-10_00:53:35.176177) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:53:37.027383 run osmo-stp_10.42.42.5(pid=5263): stderr: | 20221210005335345 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005335346 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005335346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005335346 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005335347 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005335347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005335347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:53:37.171071 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=5263): Process ended prematurely: osmo-stp_10.42.42.5(pid=5263) [trial-2367↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5263)] [trial-2367↪emergency:oc2g↪emergency_preemptive_call.py:32] 00:53:37.179683 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 00:53:37.206642 run osmo-hlr_10.42.42.2(pid=5260): ERR: Terminated: ERROR {rc=237} [trial-2367↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5260)] 00:53:37.254502 run osmo-hlr_10.42.42.2(pid=5260): stdout: | (launched: 2022-12-10_00:53:34.222260) 00:53:37.303961 run osmo-hlr_10.42.42.2(pid=5260): stderr: | 20221210005334402 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005334402 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005334402 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005334402 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005334402 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005334402 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005334414 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005334423 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005334423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005334423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:53:37.373209 run osmo-msc_10.42.42.6(pid=5266): ERR: Terminated: ERROR {rc=2} [trial-2367↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5266)] 00:53:37.420828 run osmo-msc_10.42.42.6(pid=5266): stdout: | (launched: 2022-12-10_00:53:36.297648) 00:53:37.470260 run osmo-msc_10.42.42.6(pid=5266): stderr: | 20221210005336570 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210005336570 DLGLOBAL DEBUG validating counter group 0x7f19f8d3bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210005336571 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210005336571 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210005336571 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210005336571 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210005336573 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210005336574 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210005336574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210005336574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:53:37.521495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5259): Terminating (SIGTERM) 00:53:37.561552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5262): Terminating (SIGTERM) 00:53:37.601637 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5265): Terminating (SIGTERM) 00:53:37.642091 --- ParallelTerminationStrategy: PID 5259 died... 00:53:37.661291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5259): Terminated: ok {rc=0} 00:53:37.705926 --- ParallelTerminationStrategy: PID 5262 died... 00:53:37.724456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5262): Terminated: ok {rc=0} 00:53:37.768908 --- ParallelTerminationStrategy: PID 5265 died... 00:53:37.788131 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5265): Terminated: ok {rc=0} 00:53:37.875172 bus /sierra_9: Setting Powered False 00:53:38.976434 bus /sierra_9: Setting Powered False 00:53:40.093208 bus /sierra_8: Setting Powered False 00:53:41.193244 bus /sierra_8: Setting Powered False 00:53:42.309692 bus /sierra_3: Setting Powered False 00:53:43.408330 bus /sierra_3: Setting Powered False 00:53:44.523540 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:oc2g --------------------------------------------------------------------- 00:53:45.789786 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:53:45.794583 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 00:53:45.815919 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 00:53:45.871503 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 00:53:45.966702 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 00:53:45.988395 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 00:53:46.031509 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 00:53:46.645084 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 00:53:46.715979 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:53:46.730562 tst gprs:oc2g: Using 1 x bts (candidates: 1) 00:53:46.775532 tst cs_paging_gprs_active.py: using LAC 24853 00:53:46.906809 tst cs_paging_gprs_active.py: using RAC 118 00:53:47.065878 tst cs_paging_gprs_active.py: using CellId 24853 00:53:47.202221 tst cs_paging_gprs_active.py: using BVCI 24854 00:53:47.327869 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:53:47.338782 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:53:47.349601 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:53:47.360292 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:53:47.371141 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:53:47.381793 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:53:47.392548 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:53:47.403211 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:53:47.414172 tst gprs:oc2g: Using 1 x modem (candidates: 4) 00:53:47.531443 tst gprs:oc2g: Using 1 x modem (candidates: 4) 00:53:47.651198 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:53:47.873152 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:53:48.202661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5271): Launched 00:53:48.489398 run iperf3-srv_10.42.42.10(pid=5272): Launched 00:53:48.613215 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:53:48.835261 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:53:49.166777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5273): Launched 00:53:49.452784 run iperf3-srv_10.42.42.10(pid=5274): Launched 00:53:49.575953 tst cs_paging_gprs_active.py:38: start network... 00:53:49.796869 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:53:50.307276 run create_hlr_db(pid=5275): Launched 00:53:50.441901 bus /sierra_2: Setting Powered False 00:53:51.506729 run create_hlr_db(pid=5275): Terminated: ok {rc=0} 00:53:51.942451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5277): Launched 00:53:52.249174 run osmo-hlr_10.42.42.2(pid=5278): Launched 00:53:52.366554 run osmo-stp_10.42.42.5: Starting osmo-stp 00:53:52.906218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5280): Launched 00:53:53.212805 run osmo-stp_10.42.42.5(pid=5281): Launched 00:53:53.330154 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:53:53.857558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5283): Launched 00:53:53.976624 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:53:54.237500 run patchelf(pid=5284): Launched 00:53:54.409281 run osmo-stp_10.42.42.5(pid=5281): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5281)] 00:53:54.539430 run osmo-stp_10.42.42.5(pid=5281): stdout: | (launched: 2022-12-10_00:53:53.156731) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:53:54.670719 run osmo-stp_10.42.42.5(pid=5281): stderr: | 20221210005353329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005353329 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005353329 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005353329 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005353330 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005353330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005353330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:53:54.802530 run osmo-stp_10.42.42.5(pid=5281): stdout: | (launched: 2022-12-10_00:53:53.156731) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:53:54.928048 run osmo-stp_10.42.42.5(pid=5281): stderr: | 20221210005353329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005353329 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005353329 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005353329 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005353330 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005353330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005353330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:53:55.076894 run patchelf(pid=5284): Terminating (SIGINT) 00:53:55.249684 run patchelf(pid=5284): Terminated: ok {rc=0} 00:53:55.373666 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5281): Process ended prematurely: osmo-stp_10.42.42.5(pid=5281) [trial-2367↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5281)] [trial-2367↪gprs:oc2g↪cs_paging_gprs_active.py:38] 00:53:55.383197 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 00:53:55.411083 run osmo-hlr_10.42.42.2(pid=5278): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5278)] 00:53:55.459128 run osmo-hlr_10.42.42.2(pid=5278): stdout: | (launched: 2022-12-10_00:53:52.193055) 00:53:55.508879 run osmo-hlr_10.42.42.2(pid=5278): stderr: | 20221210005352369 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005352369 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005352369 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005352369 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005352369 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005352369 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005352383 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005352393 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005352394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005352394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:53:55.559185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5271): Terminating (SIGTERM) 00:53:55.598921 run iperf3-srv_10.42.42.10(pid=5272): Terminating (SIGTERM) 00:53:55.639672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5273): Terminating (SIGTERM) 00:53:55.680038 run iperf3-srv_10.42.42.10(pid=5274): Terminating (SIGTERM) 00:53:55.720340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5277): Terminating (SIGTERM) 00:53:55.760612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5280): Terminating (SIGTERM) 00:53:55.801032 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5283): Terminating (SIGTERM) 00:53:55.841631 --- ParallelTerminationStrategy: PID 5271 died... 00:53:55.861049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5271): Terminated: ok {rc=0} 00:53:55.905724 --- ParallelTerminationStrategy: PID 5272 died... 00:53:55.924270 run iperf3-srv_10.42.42.10(pid=5272): Terminated {rc=256} 00:53:55.968761 --- ParallelTerminationStrategy: PID 5273 died... 00:53:55.987426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5273): Terminated: ok {rc=0} 00:53:56.032165 --- ParallelTerminationStrategy: PID 5274 died... 00:53:56.050900 run iperf3-srv_10.42.42.10(pid=5274): Terminated {rc=256} 00:53:56.095181 --- ParallelTerminationStrategy: PID 5277 died... 00:53:56.113897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5277): Terminated: ok {rc=0} 00:53:56.158312 --- ParallelTerminationStrategy: PID 5280 died... 00:53:56.177042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5280): Terminated: ok {rc=0} 00:53:56.221411 --- ParallelTerminationStrategy: PID 5283 died... 00:53:56.240283 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5283): Terminated: ok {rc=0} 00:53:56.328147 bus /gobi_0: Setting Powered False 00:53:57.427784 bus /gobi_0: Setting Powered False 00:53:58.542691 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:oc2g iperf3.py ---------------------------------------------- 00:53:59.690848 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:53:59.702007 tst gprs:oc2g: Using 1 x bts (candidates: 1) 00:53:59.737809 tst iperf3.py: using LAC 24854 00:53:59.858176 tst iperf3.py: using RAC 119 00:53:59.977054 tst iperf3.py: using CellId 24854 00:54:00.096783 tst iperf3.py: using BVCI 24855 00:54:00.207256 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:00.217796 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:00.228086 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:00.238706 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:00.249255 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:00.259690 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:00.270661 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:00.281117 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:00.291688 tst gprs:oc2g: Using 1 x modem (candidates: 4) 00:54:00.407184 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:54:00.613635 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:54:00.948492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5286): Launched 00:54:01.235380 run iperf3-srv_10.42.42.10(pid=5287): Launched 00:54:01.368615 tst iperf3.py:8: start network... 00:54:01.577660 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:54:02.080668 run create_hlr_db(pid=5288): Launched 00:54:02.262074 bus /gobi_6: Setting Powered False 00:54:03.325987 run create_hlr_db(pid=5288): Terminated: ok {rc=0} 00:54:03.761429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5290): Launched 00:54:04.066470 run osmo-hlr_10.42.42.2(pid=5291): Launched 00:54:04.183086 run osmo-stp_10.42.42.5: Starting osmo-stp 00:54:04.722616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5293): Launched 00:54:05.028108 run osmo-stp_10.42.42.5(pid=5294): Launched 00:54:05.145270 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:54:05.673230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5296): Launched 00:54:05.790931 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:54:06.049360 run patchelf(pid=5297): Launched 00:54:06.219958 run osmo-stp_10.42.42.5(pid=5294): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5294)] 00:54:06.349495 run osmo-stp_10.42.42.5(pid=5294): stdout: | (launched: 2022-12-10_00:54:04.972027) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:54:06.480522 run osmo-stp_10.42.42.5(pid=5294): stderr: | 20221210005405144 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005405144 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005405144 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005405145 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005405145 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005405145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005405145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:54:06.612009 run osmo-stp_10.42.42.5(pid=5294): stdout: | (launched: 2022-12-10_00:54:04.972027) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:54:06.737816 run osmo-stp_10.42.42.5(pid=5294): stderr: | 20221210005405144 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005405144 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005405144 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005405145 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005405145 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005405145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005405145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:54:06.886613 run patchelf(pid=5297): Terminating (SIGINT) 00:54:07.058189 run patchelf(pid=5297): Terminated: ok {rc=0} 00:54:07.181571 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5294): Process ended prematurely: osmo-stp_10.42.42.5(pid=5294) [trial-2367↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5294)] [trial-2367↪gprs:oc2g↪iperf3.py:8] 00:54:07.190977 tst iperf3.py:8: Test FAILED (7.5 sec) 00:54:07.218548 run osmo-hlr_10.42.42.2(pid=5291): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5291)] 00:54:07.266868 run osmo-hlr_10.42.42.2(pid=5291): stdout: | (launched: 2022-12-10_00:54:04.010784) 00:54:07.316581 run osmo-hlr_10.42.42.2(pid=5291): stderr: | 20221210005404188 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005404188 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005404188 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005404188 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005404188 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005404189 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005404202 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005404211 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005404211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005404212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:54:07.366907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5286): Terminating (SIGTERM) 00:54:07.407362 run iperf3-srv_10.42.42.10(pid=5287): Terminating (SIGTERM) 00:54:07.447520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5290): Terminating (SIGTERM) 00:54:07.488654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5293): Terminating (SIGTERM) 00:54:07.529113 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5296): Terminating (SIGTERM) 00:54:07.569604 --- ParallelTerminationStrategy: PID 5286 died... 00:54:07.588789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5286): Terminated: ok {rc=0} 00:54:07.633242 --- ParallelTerminationStrategy: PID 5287 died... 00:54:07.651837 run iperf3-srv_10.42.42.10(pid=5287): Terminated {rc=256} 00:54:07.696240 --- ParallelTerminationStrategy: PID 5290 died... 00:54:07.715011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5290): Terminated: ok {rc=0} 00:54:07.759193 --- ParallelTerminationStrategy: PID 5293 died... 00:54:07.777863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5293): Terminated: ok {rc=0} 00:54:07.822337 --- ParallelTerminationStrategy: PID 5296 died... 00:54:07.841137 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5296): Terminated: ok {rc=0} 00:54:07.925363 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:oc2g iperf3m4.py ---------------------------------------------- 00:54:09.075797 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:09.087616 tst gprs:oc2g: Using 1 x bts (candidates: 1) 00:54:09.125196 tst iperf3m4.py: using LAC 24855 00:54:09.253657 tst iperf3m4.py: using RAC 120 00:54:09.383177 tst iperf3m4.py: using CellId 24855 00:54:09.521874 tst iperf3m4.py: using BVCI 24856 00:54:09.634723 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:09.645182 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:09.655528 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:09.666182 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:09.676550 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:09.687185 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:09.697850 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:09.708211 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:09.718798 tst gprs:oc2g: Using 1 x modem (candidates: 4) 00:54:09.841182 tst gprs:oc2g: Using 1 x modem (candidates: 4) 00:54:09.958777 tst gprs:oc2g: Using 1 x modem (candidates: 4) 00:54:10.078700 tst gprs:oc2g: Using 1 x modem (candidates: 4) 00:54:10.195402 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:54:10.401156 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:54:10.710353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5298): Launched 00:54:10.977875 run iperf3-srv_10.42.42.10(pid=5299): Launched 00:54:11.093679 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:54:11.298962 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:54:11.606113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5300): Launched 00:54:11.872503 run iperf3-srv_10.42.42.10(pid=5301): Launched 00:54:12.017218 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:54:12.222333 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:54:12.529997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5302): Launched 00:54:12.797842 run iperf3-srv_10.42.42.10(pid=5303): Launched 00:54:12.913918 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:54:13.119427 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:54:13.427138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5304): Launched 00:54:13.693805 run iperf3-srv_10.42.42.10(pid=5305): Launched 00:54:13.809479 tst iperf3m4.py:8: start network... 00:54:14.013851 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:54:14.487867 run create_hlr_db(pid=5306): Launched 00:54:14.606167 bus /gobi_6: Setting Powered False 00:54:15.666998 run create_hlr_db(pid=5306): Terminated: ok {rc=0} 00:54:16.137790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5308): Launched 00:54:16.465711 run osmo-hlr_10.42.42.2(pid=5309): Launched 00:54:16.695387 run osmo-stp_10.42.42.5: Starting osmo-stp 00:54:17.322534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5311): Launched 00:54:17.664015 run osmo-stp_10.42.42.5(pid=5312): Launched 00:54:17.790044 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:54:18.360313 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5314): Launched 00:54:18.486075 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:54:18.763443 run patchelf(pid=5315): Launched 00:54:18.946289 run osmo-stp_10.42.42.5(pid=5312): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5312)] 00:54:19.084155 run osmo-stp_10.42.42.5(pid=5312): stdout: | (launched: 2022-12-10_00:54:17.603643) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:54:19.223687 run osmo-stp_10.42.42.5(pid=5312): stderr: | 20221210005417797 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005417797 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005417797 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005417798 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005417798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005417798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005417798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:54:19.363716 run osmo-stp_10.42.42.5(pid=5312): stdout: | (launched: 2022-12-10_00:54:17.603643) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:54:19.497996 run osmo-stp_10.42.42.5(pid=5312): stderr: | 20221210005417797 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005417797 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005417797 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005417798 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005417798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005417798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005417798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:54:19.657212 run patchelf(pid=5315): Terminating (SIGINT) 00:54:19.839870 run patchelf(pid=5315): Terminated: ok {rc=0} 00:54:19.971693 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5312): Process ended prematurely: osmo-stp_10.42.42.5(pid=5312) [trial-2367↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5312)] [trial-2367↪gprs:oc2g↪iperf3m4.py:8] 00:54:19.981750 tst iperf3m4.py:8: Test FAILED (10.9 sec) 00:54:20.010717 run osmo-hlr_10.42.42.2(pid=5309): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5309)] 00:54:20.060727 run osmo-hlr_10.42.42.2(pid=5309): stdout: | (launched: 2022-12-10_00:54:16.396460) 00:54:20.112630 run osmo-hlr_10.42.42.2(pid=5309): stderr: | 20221210005416612 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005416612 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005416612 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005416612 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005416612 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005416612 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005416629 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005416644 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005416650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005416652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:54:20.164852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5298): Terminating (SIGTERM) 00:54:20.206796 run iperf3-srv_10.42.42.10(pid=5299): Terminating (SIGTERM) 00:54:20.248587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5300): Terminating (SIGTERM) 00:54:20.290863 run iperf3-srv_10.42.42.10(pid=5301): Terminating (SIGTERM) 00:54:20.332542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5302): Terminating (SIGTERM) 00:54:20.374346 run iperf3-srv_10.42.42.10(pid=5303): Terminating (SIGTERM) 00:54:20.416015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5304): Terminating (SIGTERM) 00:54:20.457916 run iperf3-srv_10.42.42.10(pid=5305): Terminating (SIGTERM) 00:54:20.499490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5308): Terminating (SIGTERM) 00:54:20.541308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5311): Terminating (SIGTERM) 00:54:20.583251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5314): Terminating (SIGTERM) 00:54:20.625491 --- ParallelTerminationStrategy: PID 5298 died... 00:54:20.645583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5298): Terminated: ok {rc=0} 00:54:20.692522 --- ParallelTerminationStrategy: PID 5299 died... 00:54:20.712138 run iperf3-srv_10.42.42.10(pid=5299): Terminated {rc=256} 00:54:20.758238 --- ParallelTerminationStrategy: PID 5300 died... 00:54:20.777818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5300): Terminated: ok {rc=0} 00:54:20.823839 --- ParallelTerminationStrategy: PID 5301 died... 00:54:20.843520 run iperf3-srv_10.42.42.10(pid=5301): Terminated {rc=256} 00:54:20.890088 --- ParallelTerminationStrategy: PID 5302 died... 00:54:20.909738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5302): Terminated: ok {rc=0} 00:54:20.955957 --- ParallelTerminationStrategy: PID 5303 died... 00:54:20.975595 run iperf3-srv_10.42.42.10(pid=5303): Terminated {rc=256} 00:54:21.021809 --- ParallelTerminationStrategy: PID 5304 died... 00:54:21.041553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5304): Terminated: ok {rc=0} 00:54:21.087909 --- ParallelTerminationStrategy: PID 5305 died... 00:54:21.107639 run iperf3-srv_10.42.42.10(pid=5305): Terminated {rc=256} 00:54:21.153888 --- ParallelTerminationStrategy: PID 5308 died... 00:54:21.173706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5308): Terminated: ok {rc=0} 00:54:21.219976 --- ParallelTerminationStrategy: PID 5311 died... 00:54:21.239820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5311): Terminated: ok {rc=0} 00:54:21.286572 --- ParallelTerminationStrategy: PID 5314 died... 00:54:21.306277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5314): Terminated: ok {rc=0} 00:54:21.394428 bus /gobi_4: Setting Powered False 00:54:22.493486 bus /gobi_4: Setting Powered False 00:54:23.611215 bus /gobi_1: Setting Powered False 00:54:24.708250 bus /gobi_1: Setting Powered False 00:54:25.824305 bus /gobi_0: Setting Powered False 00:54:26.923228 bus /gobi_0: Setting Powered False 00:54:28.039544 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:oc2g ping.py ---------------------------------------------- 00:54:29.142187 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:29.153870 tst gprs:oc2g: Using 1 x bts (candidates: 1) 00:54:29.190595 tst ping.py: using LAC 24856 00:54:29.316780 tst ping.py: using RAC 121 00:54:29.443298 tst ping.py: using CellId 24856 00:54:29.571654 tst ping.py: using BVCI 24857 00:54:29.688835 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:29.699874 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:29.710735 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:29.721523 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:29.732132 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:29.742836 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:29.753708 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:29.764382 tst gprs:oc2g: Using 1 x modem (candidates: 4) 00:54:29.879147 tst ping.py:19: start network... 00:54:30.097434 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:54:30.597454 run create_hlr_db(pid=5317): Launched 00:54:30.729297 bus /gobi_6: Setting Powered False 00:54:31.794045 run create_hlr_db(pid=5317): Terminated: ok {rc=0} 00:54:32.253714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5319): Launched 00:54:32.587487 run osmo-hlr_10.42.42.2(pid=5320): Launched 00:54:32.710994 run osmo-stp_10.42.42.5: Starting osmo-stp 00:54:33.273022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5322): Launched 00:54:33.596720 run osmo-stp_10.42.42.5(pid=5323): Launched 00:54:33.719395 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:54:34.275238 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5325): Launched 00:54:34.399115 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:54:34.671368 run patchelf(pid=5326): Launched 00:54:34.851206 run osmo-stp_10.42.42.5(pid=5323): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5323)] 00:54:34.987856 run osmo-stp_10.42.42.5(pid=5323): stdout: | (launched: 2022-12-10_00:54:33.537259) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:54:35.125976 run osmo-stp_10.42.42.5(pid=5323): stderr: | 20221210005433730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005433730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005433730 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005433731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005433733 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005433733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005433733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:54:35.263459 run osmo-stp_10.42.42.5(pid=5323): stdout: | (launched: 2022-12-10_00:54:33.537259) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:54:35.396149 run osmo-stp_10.42.42.5(pid=5323): stderr: | 20221210005433730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005433730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005433730 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005433731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005433733 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005433733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005433733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:54:35.553352 run patchelf(pid=5326): Terminating (SIGINT) 00:54:35.733308 run patchelf(pid=5326): Terminated: ok {rc=0} 00:54:35.862726 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5323): Process ended prematurely: osmo-stp_10.42.42.5(pid=5323) [trial-2367↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5323)] [trial-2367↪gprs:oc2g↪ping.py:22] 00:54:35.872255 tst ping.py:22: Test FAILED (6.7 sec) 00:54:35.901146 run osmo-hlr_10.42.42.2(pid=5320): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5320)] 00:54:35.951523 run osmo-hlr_10.42.42.2(pid=5320): stdout: | (launched: 2022-12-10_00:54:32.527851) 00:54:36.003594 run osmo-hlr_10.42.42.2(pid=5320): stderr: | 20221210005432726 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005432726 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005432726 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005432726 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005432727 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005432727 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005432739 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005432747 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005432748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005432748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:54:36.056014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5319): Terminating (SIGTERM) 00:54:36.098310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5322): Terminating (SIGTERM) 00:54:36.140288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5325): Terminating (SIGTERM) 00:54:36.182689 --- ParallelTerminationStrategy: PID 5319 died... 00:54:36.202976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5319): Terminated: ok {rc=0} 00:54:36.249638 --- ParallelTerminationStrategy: PID 5322 died... 00:54:36.269307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5322): Terminated: ok {rc=0} 00:54:36.315953 --- ParallelTerminationStrategy: PID 5325 died... 00:54:36.335909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5325): Terminated: ok {rc=0} 00:54:36.423831 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 00:54:37.509651 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:37.520776 tst gprs:oc2g: Using 1 x bts (candidates: 1) 00:54:37.557329 tst ping_idle_ping.py: using LAC 24857 00:54:37.676104 tst ping_idle_ping.py: using RAC 122 00:54:37.793709 tst ping_idle_ping.py: using CellId 24857 00:54:37.911382 tst ping_idle_ping.py: using BVCI 24858 00:54:38.022112 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:38.032570 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:38.043038 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:38.053755 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:38.064186 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:38.074979 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:38.085404 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:38.095967 tst gprs:oc2g: Using 1 x modem (candidates: 4) 00:54:38.211712 tst ping_idle_ping.py:24: start network... 00:54:38.430781 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:54:38.936103 run create_hlr_db(pid=5327): Launched 00:54:39.068916 bus /gobi_6: Setting Powered False 00:54:40.133678 run create_hlr_db(pid=5327): Terminated: ok {rc=0} 00:54:40.583392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5329): Launched 00:54:40.908663 run osmo-hlr_10.42.42.2(pid=5330): Launched 00:54:41.032117 run osmo-stp_10.42.42.5: Starting osmo-stp 00:54:41.591330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5332): Launched 00:54:41.915205 run osmo-stp_10.42.42.5(pid=5333): Launched 00:54:42.038885 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:54:42.596392 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5335): Launched 00:54:42.720032 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:54:42.994100 run patchelf(pid=5336): Launched 00:54:43.173978 run osmo-stp_10.42.42.5(pid=5333): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5333)] 00:54:43.310339 run osmo-stp_10.42.42.5(pid=5333): stdout: | (launched: 2022-12-10_00:54:41.855290) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:54:43.448145 run osmo-stp_10.42.42.5(pid=5333): stderr: | 20221210005442047 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005442048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005442048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005442048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005442051 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005442051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005442051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:54:43.585835 run osmo-stp_10.42.42.5(pid=5333): stdout: | (launched: 2022-12-10_00:54:41.855290) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:54:43.718169 run osmo-stp_10.42.42.5(pid=5333): stderr: | 20221210005442047 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005442048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005442048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005442048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005442051 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005442051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005442051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:54:43.875030 run patchelf(pid=5336): Terminating (SIGINT) 00:54:44.055800 run patchelf(pid=5336): Terminated: ok {rc=0} 00:54:44.185257 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5333): Process ended prematurely: osmo-stp_10.42.42.5(pid=5333) [trial-2367↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5333)] [trial-2367↪gprs:oc2g↪ping_idle_ping.py:27] 00:54:44.194694 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 00:54:44.222944 run osmo-hlr_10.42.42.2(pid=5330): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5330)] 00:54:44.272804 run osmo-hlr_10.42.42.2(pid=5330): stdout: | (launched: 2022-12-10_00:54:40.848679) 00:54:44.324624 run osmo-hlr_10.42.42.2(pid=5330): stderr: | 20221210005441048 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005441048 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005441048 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005441048 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005441048 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005441048 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005441061 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005441070 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005441070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005441070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:54:44.376702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5329): Terminating (SIGTERM) 00:54:44.418579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5332): Terminating (SIGTERM) 00:54:44.460519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5335): Terminating (SIGTERM) 00:54:44.502779 --- ParallelTerminationStrategy: PID 5329 died... 00:54:44.522737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5329): Terminated: ok {rc=0} 00:54:44.569205 --- ParallelTerminationStrategy: PID 5332 died... 00:54:44.588850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5332): Terminated: ok {rc=0} 00:54:44.634994 --- ParallelTerminationStrategy: PID 5335 died... 00:54:44.654562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5335): Terminated: ok {rc=0} 00:54:44.741507 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 00:54:46.059624 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:54:46.067078 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 00:54:46.089735 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 00:54:46.130310 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 00:54:46.223839 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 00:54:46.261467 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 00:54:46.310634 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 00:54:46.873287 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 00:54:46.943101 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:54:46.959872 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:54:47.005220 tst cs_paging_gprs_active.py: using LAC 24858 00:54:47.165799 tst cs_paging_gprs_active.py: using RAC 123 00:54:47.300746 tst cs_paging_gprs_active.py: using CellId 24858 00:54:47.424017 tst cs_paging_gprs_active.py: using BVCI 24859 00:54:47.534904 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:54:47.545737 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:54:47.556183 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:54:47.566860 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:54:47.577800 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:54:47.588341 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:54:47.599302 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:54:47.609821 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:54:47.620694 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:54:47.735650 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:54:47.853554 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:54:48.073381 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:54:48.401735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5340): Launched 00:54:48.666480 run iperf3-srv_10.42.42.10(pid=5341): Launched 00:54:48.780074 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:54:48.982673 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:54:49.284519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5342): Launched 00:54:49.547951 run iperf3-srv_10.42.42.10(pid=5343): Launched 00:54:49.661532 tst cs_paging_gprs_active.py:38: start network... 00:54:49.862627 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:54:50.331597 run create_hlr_db(pid=5344): Launched 00:54:50.447507 bus /gobi_6: Setting Powered False 00:54:51.507020 run create_hlr_db(pid=5344): Terminated: ok {rc=0} 00:54:51.927070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5346): Launched 00:54:52.228904 run osmo-hlr_10.42.42.2(pid=5347): Launched 00:54:52.344850 run osmo-stp_10.42.42.5: Starting osmo-stp 00:54:52.870586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5349): Launched 00:54:53.171441 run osmo-stp_10.42.42.5(pid=5350): Launched 00:54:53.286562 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:54:53.804846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5352): Launched 00:54:53.920759 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:54:54.175855 run patchelf(pid=5353): Launched 00:54:54.343525 run osmo-stp_10.42.42.5(pid=5350): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5350)] 00:54:54.470636 run osmo-stp_10.42.42.5(pid=5350): stdout: | (launched: 2022-12-10_00:54:53.116379) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:54:54.599908 run osmo-stp_10.42.42.5(pid=5350): stderr: | 20221210005453288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005453288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005453289 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005453289 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005453290 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005453290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005453290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:54:54.728696 run osmo-stp_10.42.42.5(pid=5350): stdout: | (launched: 2022-12-10_00:54:53.116379) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:54:54.852212 run osmo-stp_10.42.42.5(pid=5350): stderr: | 20221210005453288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005453288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005453289 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005453289 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005453290 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005453290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005453290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:54:54.998885 run patchelf(pid=5353): Terminating (SIGINT) 00:54:55.167193 run patchelf(pid=5353): Terminated: ok {rc=0} 00:54:55.288564 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5350): Process ended prematurely: osmo-stp_10.42.42.5(pid=5350) [trial-2367↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5350)] [trial-2367↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 00:54:55.298256 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 00:54:55.325808 run osmo-hlr_10.42.42.2(pid=5347): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5347)] 00:54:55.373795 run osmo-hlr_10.42.42.2(pid=5347): stdout: | (launched: 2022-12-10_00:54:52.173417) 00:54:55.423348 run osmo-hlr_10.42.42.2(pid=5347): stderr: | 20221210005452351 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005452351 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005452351 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005452351 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005452351 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005452351 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005452363 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005452371 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005452371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005452371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:54:55.473442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5340): Terminating (SIGTERM) 00:54:55.513570 run iperf3-srv_10.42.42.10(pid=5341): Terminating (SIGTERM) 00:54:55.553616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5342): Terminating (SIGTERM) 00:54:55.593775 run iperf3-srv_10.42.42.10(pid=5343): Terminating (SIGTERM) 00:54:55.633642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5346): Terminating (SIGTERM) 00:54:55.673835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5349): Terminating (SIGTERM) 00:54:55.713756 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5352): Terminating (SIGTERM) 00:54:55.753771 --- ParallelTerminationStrategy: PID 5340 died... 00:54:55.772767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5340): Terminated: ok {rc=0} 00:54:55.817323 --- ParallelTerminationStrategy: PID 5341 died... 00:54:55.835838 run iperf3-srv_10.42.42.10(pid=5341): Terminated {rc=256} 00:54:55.879926 --- ParallelTerminationStrategy: PID 5342 died... 00:54:55.898495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5342): Terminated: ok {rc=0} 00:54:55.942714 --- ParallelTerminationStrategy: PID 5343 died... 00:54:55.961329 run iperf3-srv_10.42.42.10(pid=5343): Terminated {rc=256} 00:54:56.005366 --- ParallelTerminationStrategy: PID 5346 died... 00:54:56.023828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5346): Terminated: ok {rc=0} 00:54:56.067972 --- ParallelTerminationStrategy: PID 5349 died... 00:54:56.086607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5349): Terminated: ok {rc=0} 00:54:56.130991 --- ParallelTerminationStrategy: PID 5352 died... 00:54:56.149689 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5352): Terminated: ok {rc=0} 00:54:56.235924 bus /gobi_0: Setting Powered False 00:54:57.335949 bus /gobi_0: Setting Powered False 00:54:58.448929 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 00:54:59.597769 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:54:59.609605 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:54:59.647969 tst iperf3.py: using LAC 24859 00:54:59.773499 tst iperf3.py: using RAC 124 00:54:59.900614 tst iperf3.py: using CellId 24859 00:55:00.020602 tst iperf3.py: using BVCI 24860 00:55:00.129560 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:00.140260 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:00.151033 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:00.161998 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:00.172807 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:00.183769 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:00.194651 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:00.205404 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:00.216404 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:55:00.336932 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:55:00.553793 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:55:00.898301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5354): Launched 00:55:01.198295 run iperf3-srv_10.42.42.10(pid=5355): Launched 00:55:01.334680 tst iperf3.py:8: start network... 00:55:01.555424 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:55:02.140078 run create_hlr_db(pid=5359): Launched 00:55:02.295626 bus /gobi_6: Setting Powered False 00:55:03.358444 run create_hlr_db(pid=5359): Terminated: ok {rc=0} 00:55:03.804693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5361): Launched 00:55:04.125739 run osmo-hlr_10.42.42.2(pid=5362): Launched 00:55:04.248112 run osmo-stp_10.42.42.5: Starting osmo-stp 00:55:04.805219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5364): Launched 00:55:05.128423 run osmo-stp_10.42.42.5(pid=5365): Launched 00:55:05.250798 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:55:05.804891 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5367): Launched 00:55:05.928045 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:55:06.199619 run patchelf(pid=5368): Launched 00:55:06.379164 run osmo-stp_10.42.42.5(pid=5365): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5365)] 00:55:06.515201 run osmo-stp_10.42.42.5(pid=5365): stdout: | (launched: 2022-12-10_00:55:05.069461) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:55:06.652863 run osmo-stp_10.42.42.5(pid=5365): stderr: | 20221210005505263 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005505263 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005505264 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005505264 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005505264 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005505265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005505265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:55:06.790530 run osmo-stp_10.42.42.5(pid=5365): stdout: | (launched: 2022-12-10_00:55:05.069461) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:55:06.923229 run osmo-stp_10.42.42.5(pid=5365): stderr: | 20221210005505263 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005505263 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005505264 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005505264 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005505264 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005505265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005505265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:55:07.080091 run patchelf(pid=5368): Terminating (SIGINT) 00:55:07.259392 run patchelf(pid=5368): Terminated: ok {rc=0} 00:55:07.388592 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5365): Process ended prematurely: osmo-stp_10.42.42.5(pid=5365) [trial-2367↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5365)] [trial-2367↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 00:55:07.398796 tst iperf3.py:8: Test FAILED (7.8 sec) 00:55:07.427184 run osmo-hlr_10.42.42.2(pid=5362): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5362)] 00:55:07.477332 run osmo-hlr_10.42.42.2(pid=5362): stdout: | (launched: 2022-12-10_00:55:04.067257) 00:55:07.529153 run osmo-hlr_10.42.42.2(pid=5362): stderr: | 20221210005504268 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005504268 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005504268 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005504268 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005504268 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005504268 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005504281 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005504289 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005504290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005504290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:55:07.581491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5354): Terminating (SIGTERM) 00:55:07.623456 run iperf3-srv_10.42.42.10(pid=5355): Terminating (SIGTERM) 00:55:07.666645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5361): Terminating (SIGTERM) 00:55:07.708633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5364): Terminating (SIGTERM) 00:55:07.750864 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5367): Terminating (SIGTERM) 00:55:07.792618 --- ParallelTerminationStrategy: PID 5354 died... 00:55:07.812527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5354): Terminated: ok {rc=0} 00:55:07.858609 --- ParallelTerminationStrategy: PID 5355 died... 00:55:07.878009 run iperf3-srv_10.42.42.10(pid=5355): Terminated {rc=256} 00:55:07.924019 --- ParallelTerminationStrategy: PID 5361 died... 00:55:07.943601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5361): Terminated: ok {rc=0} 00:55:07.989420 --- ParallelTerminationStrategy: PID 5364 died... 00:55:08.008832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5364): Terminated: ok {rc=0} 00:55:08.054760 --- ParallelTerminationStrategy: PID 5367 died... 00:55:08.074433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5367): Terminated: ok {rc=0} 00:55:08.162789 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 00:55:09.313607 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:09.325530 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:55:09.361506 tst iperf3m4.py: using LAC 24860 00:55:09.488581 tst iperf3m4.py: using RAC 125 00:55:09.615843 tst iperf3m4.py: using CellId 24860 00:55:09.743029 tst iperf3m4.py: using BVCI 24861 00:55:09.859909 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:09.871081 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:09.882156 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:09.893578 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:09.904457 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:09.915435 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:09.926629 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:09.937590 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:09.948817 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:55:10.066072 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:55:10.180702 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:55:10.298006 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:55:10.411743 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:55:10.613417 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:55:10.916812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5369): Launched 00:55:11.179369 run iperf3-srv_10.42.42.10(pid=5370): Launched 00:55:11.293081 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:55:11.493705 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:55:11.795436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5371): Launched 00:55:12.058549 run iperf3-srv_10.42.42.10(pid=5372): Launched 00:55:12.172161 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:55:12.373120 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:55:12.674854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5373): Launched 00:55:12.936882 run iperf3-srv_10.42.42.10(pid=5374): Launched 00:55:13.050306 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:55:13.250774 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:55:13.552018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5375): Launched 00:55:13.814702 run iperf3-srv_10.42.42.10(pid=5376): Launched 00:55:13.927933 tst iperf3m4.py:8: start network... 00:55:14.128168 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:55:14.593990 run create_hlr_db(pid=5377): Launched 00:55:14.709775 bus /gobi_6: Setting Powered False 00:55:15.769448 run create_hlr_db(pid=5377): Terminated: ok {rc=0} 00:55:16.245958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5379): Launched 00:55:16.582939 run osmo-hlr_10.42.42.2(pid=5380): Launched 00:55:16.787513 run osmo-stp_10.42.42.5: Starting osmo-stp 00:55:17.487967 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5382): Launched 00:55:17.810373 run osmo-stp_10.42.42.5(pid=5383): Launched 00:55:17.933647 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:55:18.489467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5385): Launched 00:55:18.614431 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:55:18.887256 run patchelf(pid=5386): Launched 00:55:19.067084 run osmo-stp_10.42.42.5(pid=5383): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5383)] 00:55:19.204384 run osmo-stp_10.42.42.5(pid=5383): stdout: | (launched: 2022-12-10_00:55:17.751480) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:55:19.342795 run osmo-stp_10.42.42.5(pid=5383): stderr: | 20221210005517942 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005517942 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005517942 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005517943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005517945 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005517945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005517945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:55:19.481281 run osmo-stp_10.42.42.5(pid=5383): stdout: | (launched: 2022-12-10_00:55:17.751480) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:55:19.614236 run osmo-stp_10.42.42.5(pid=5383): stderr: | 20221210005517942 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005517942 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005517942 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005517943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005517945 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005517945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005517945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:55:19.771292 run patchelf(pid=5386): Terminating (SIGINT) 00:55:19.951910 run patchelf(pid=5386): Terminated: ok {rc=0} 00:55:20.081920 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5383): Process ended prematurely: osmo-stp_10.42.42.5(pid=5383) [trial-2367↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5383)] [trial-2367↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 00:55:20.092176 tst iperf3m4.py:8: Test FAILED (10.8 sec) 00:55:20.121214 run osmo-hlr_10.42.42.2(pid=5380): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5380)] 00:55:20.171891 run osmo-hlr_10.42.42.2(pid=5380): stdout: | (launched: 2022-12-10_00:55:16.519939) 00:55:20.224277 run osmo-hlr_10.42.42.2(pid=5380): stderr: | 20221210005516857 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005516858 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005516858 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005516858 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005516858 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005516858 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005516881 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005516890 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005516890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005516890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:55:20.277286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5369): Terminating (SIGTERM) 00:55:20.319478 run iperf3-srv_10.42.42.10(pid=5370): Terminating (SIGTERM) 00:55:20.361576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5371): Terminating (SIGTERM) 00:55:20.403610 run iperf3-srv_10.42.42.10(pid=5372): Terminating (SIGTERM) 00:55:20.445626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5373): Terminating (SIGTERM) 00:55:20.487541 run iperf3-srv_10.42.42.10(pid=5374): Terminating (SIGTERM) 00:55:20.529394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5375): Terminating (SIGTERM) 00:55:20.571415 run iperf3-srv_10.42.42.10(pid=5376): Terminating (SIGTERM) 00:55:20.614503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5379): Terminating (SIGTERM) 00:55:20.656789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5382): Terminating (SIGTERM) 00:55:20.698795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5385): Terminating (SIGTERM) 00:55:20.741071 --- ParallelTerminationStrategy: PID 5369 died... 00:55:20.761265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5369): Terminated: ok {rc=0} 00:55:20.808028 --- ParallelTerminationStrategy: PID 5370 died... 00:55:20.827717 run iperf3-srv_10.42.42.10(pid=5370): Terminated {rc=256} 00:55:20.873984 --- ParallelTerminationStrategy: PID 5371 died... 00:55:20.893634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5371): Terminated: ok {rc=0} 00:55:20.940167 --- ParallelTerminationStrategy: PID 5372 died... 00:55:20.959894 run iperf3-srv_10.42.42.10(pid=5372): Terminated {rc=256} 00:55:21.005924 --- ParallelTerminationStrategy: PID 5373 died... 00:55:21.025525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5373): Terminated: ok {rc=0} 00:55:21.071652 --- ParallelTerminationStrategy: PID 5374 died... 00:55:21.091326 run iperf3-srv_10.42.42.10(pid=5374): Terminated {rc=256} 00:55:21.137878 --- ParallelTerminationStrategy: PID 5375 died... 00:55:21.157652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5375): Terminated: ok {rc=0} 00:55:21.203890 --- ParallelTerminationStrategy: PID 5376 died... 00:55:21.223265 run iperf3-srv_10.42.42.10(pid=5376): Terminated {rc=256} 00:55:21.269730 --- ParallelTerminationStrategy: PID 5379 died... 00:55:21.289369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5379): Terminated: ok {rc=0} 00:55:21.335590 --- ParallelTerminationStrategy: PID 5382 died... 00:55:21.355298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5382): Terminated: ok {rc=0} 00:55:21.401610 --- ParallelTerminationStrategy: PID 5385 died... 00:55:21.421267 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5385): Terminated: ok {rc=0} 00:55:21.509518 bus /gobi_4: Setting Powered False 00:55:22.609112 bus /gobi_4: Setting Powered False 00:55:23.724281 bus /gobi_1: Setting Powered False 00:55:24.824640 bus /gobi_1: Setting Powered False 00:55:25.939736 bus /gobi_0: Setting Powered False 00:55:27.039286 bus /gobi_0: Setting Powered False 00:55:28.156201 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 00:55:29.259294 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:29.271075 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:55:29.309119 tst ping.py: using LAC 24861 00:55:29.433161 tst ping.py: using RAC 126 00:55:29.557062 tst ping.py: using CellId 24861 00:55:29.682173 tst ping.py: using BVCI 24862 00:55:29.797927 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:29.809126 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:29.820147 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:29.831221 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:29.842157 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:29.853145 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:29.864145 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:29.875149 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:55:29.993195 tst ping.py:19: start network... 00:55:30.205067 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:55:30.693402 run create_hlr_db(pid=5387): Launched 00:55:30.822205 bus /gobi_6: Setting Powered False 00:55:31.887737 run create_hlr_db(pid=5387): Terminated: ok {rc=0} 00:55:32.320576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5389): Launched 00:55:32.624872 run osmo-hlr_10.42.42.2(pid=5390): Launched 00:55:32.738590 run osmo-stp_10.42.42.5: Starting osmo-stp 00:55:33.262031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5392): Launched 00:55:33.559864 run osmo-stp_10.42.42.5(pid=5393): Launched 00:55:33.673535 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:55:34.182942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5395): Launched 00:55:34.296538 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:55:34.546001 run patchelf(pid=5396): Launched 00:55:34.711193 run osmo-stp_10.42.42.5(pid=5393): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5393)] 00:55:34.836655 run osmo-stp_10.42.42.5(pid=5393): stdout: | (launched: 2022-12-10_00:55:33.504846) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:55:34.963840 run osmo-stp_10.42.42.5(pid=5393): stderr: | 20221210005533677 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005533677 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005533677 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005533678 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005533678 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005533678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005533678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:55:35.091426 run osmo-stp_10.42.42.5(pid=5393): stdout: | (launched: 2022-12-10_00:55:33.504846) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:55:35.213379 run osmo-stp_10.42.42.5(pid=5393): stderr: | 20221210005533677 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005533677 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005533677 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005533678 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005533678 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005533678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005533678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:55:35.358302 run patchelf(pid=5396): Terminating (SIGINT) 00:55:35.524673 run patchelf(pid=5396): Terminated: ok {rc=0} 00:55:35.644051 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5393): Process ended prematurely: osmo-stp_10.42.42.5(pid=5393) [trial-2367↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5393)] [trial-2367↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 00:55:35.653215 tst ping.py:22: Test FAILED (6.4 sec) 00:55:35.680375 run osmo-hlr_10.42.42.2(pid=5390): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5390)] 00:55:35.728080 run osmo-hlr_10.42.42.2(pid=5390): stdout: | (launched: 2022-12-10_00:55:32.569565) 00:55:35.777520 run osmo-hlr_10.42.42.2(pid=5390): stderr: | 20221210005532746 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005532746 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005532746 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005532746 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005532746 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005532747 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005532759 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005532770 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005532770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005532770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:55:35.827488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5389): Terminating (SIGTERM) 00:55:35.867239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5392): Terminating (SIGTERM) 00:55:35.906935 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5395): Terminating (SIGTERM) 00:55:35.946787 --- ParallelTerminationStrategy: PID 5389 died... 00:55:35.965809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5389): Terminated: ok {rc=0} 00:55:36.010308 --- ParallelTerminationStrategy: PID 5392 died... 00:55:36.029090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5392): Terminated: ok {rc=0} 00:55:36.073181 --- ParallelTerminationStrategy: PID 5395 died... 00:55:36.091569 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5395): Terminated: ok {rc=0} 00:55:36.177373 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 00:55:37.266319 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:37.278521 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:55:37.317463 tst ping_idle_ping.py: using LAC 24862 00:55:37.439992 tst ping_idle_ping.py: using RAC 127 00:55:37.556886 tst ping_idle_ping.py: using CellId 24862 00:55:37.671363 tst ping_idle_ping.py: using BVCI 24863 00:55:37.778734 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:37.789535 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:37.800124 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:37.810905 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:37.821592 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:37.832133 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:37.842955 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:37.853709 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:55:37.971983 tst ping_idle_ping.py:24: start network... 00:55:38.185156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:55:38.678980 run create_hlr_db(pid=5397): Launched 00:55:38.808393 bus /gobi_6: Setting Powered False 00:55:39.871836 run create_hlr_db(pid=5397): Terminated: ok {rc=0} 00:55:40.298620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5399): Launched 00:55:40.597729 run osmo-hlr_10.42.42.2(pid=5400): Launched 00:55:40.711213 run osmo-stp_10.42.42.5: Starting osmo-stp 00:55:41.226393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5402): Launched 00:55:41.524534 run osmo-stp_10.42.42.5(pid=5403): Launched 00:55:41.638557 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:55:42.154292 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5405): Launched 00:55:42.269260 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:55:42.521544 run patchelf(pid=5406): Launched 00:55:42.689035 run osmo-stp_10.42.42.5(pid=5403): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5403)] 00:55:42.815330 run osmo-stp_10.42.42.5(pid=5403): stdout: | (launched: 2022-12-10_00:55:41.469396) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:55:42.943853 run osmo-stp_10.42.42.5(pid=5403): stderr: | 20221210005541639 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005541639 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005541640 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005541640 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005541641 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005541641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005541641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:55:43.072374 run osmo-stp_10.42.42.5(pid=5403): stdout: | (launched: 2022-12-10_00:55:41.469396) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:55:43.195982 run osmo-stp_10.42.42.5(pid=5403): stderr: | 20221210005541639 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005541639 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005541640 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005541640 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005541641 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005541641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005541641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:55:43.342439 run patchelf(pid=5406): Terminating (SIGINT) 00:55:43.509802 run patchelf(pid=5406): Terminated: ok {rc=0} 00:55:43.630311 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5403): Process ended prematurely: osmo-stp_10.42.42.5(pid=5403) [trial-2367↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5403)] [trial-2367↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 00:55:43.639204 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 00:55:43.666668 run osmo-hlr_10.42.42.2(pid=5400): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5400)] 00:55:43.715090 run osmo-hlr_10.42.42.2(pid=5400): stdout: | (launched: 2022-12-10_00:55:40.542770) 00:55:43.765157 run osmo-hlr_10.42.42.2(pid=5400): stderr: | 20221210005540720 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005540721 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005540721 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005540721 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005540721 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005540721 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005540732 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005540741 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005540742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005540742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:55:43.815647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5399): Terminating (SIGTERM) 00:55:43.856132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5402): Terminating (SIGTERM) 00:55:43.896395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5405): Terminating (SIGTERM) 00:55:43.937829 --- ParallelTerminationStrategy: PID 5399 died... 00:55:43.956822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5399): Terminated: ok {rc=0} 00:55:44.001683 --- ParallelTerminationStrategy: PID 5402 died... 00:55:44.020238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5402): Terminated: ok {rc=0} 00:55:44.064796 --- ParallelTerminationStrategy: PID 5405 died... 00:55:44.083970 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5405): Terminated: ok {rc=0} 00:55:44.171016 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 00:55:45.468205 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:55:45.474543 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 00:55:45.495816 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 00:55:45.534122 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 00:55:45.619144 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 00:55:45.639345 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 00:55:45.677346 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 00:55:46.305039 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 00:55:46.356839 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:55:46.368278 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:55:46.425687 tst cs_paging_gprs_active.py: using LAC 24863 00:55:46.547761 tst cs_paging_gprs_active.py: using RAC 128 00:55:46.673515 tst cs_paging_gprs_active.py: using CellId 24863 00:55:46.828591 tst cs_paging_gprs_active.py: using BVCI 24864 00:55:46.942514 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:55:46.953793 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:55:46.964738 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:55:46.976324 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:55:46.987681 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:55:47.000090 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:55:47.011604 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:55:47.022814 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:55:47.034415 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:55:47.177589 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:55:47.313139 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:55:47.518338 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:55:47.821909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5411): Launched 00:55:48.088177 run iperf3-srv_10.42.42.10(pid=5412): Launched 00:55:48.202825 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:55:48.405843 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:55:48.710587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5413): Launched 00:55:48.975138 run iperf3-srv_10.42.42.10(pid=5414): Launched 00:55:49.089622 tst cs_paging_gprs_active.py:38: start network... 00:55:49.292257 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:55:49.762169 run create_hlr_db(pid=5415): Launched 00:55:49.879812 bus /gobi_6: Setting Powered False 00:55:50.939941 run create_hlr_db(pid=5415): Terminated: ok {rc=0} 00:55:51.362314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5417): Launched 00:55:51.666995 run osmo-hlr_10.42.42.2(pid=5418): Launched 00:55:51.783191 run osmo-stp_10.42.42.5: Starting osmo-stp 00:55:52.306309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5420): Launched 00:55:52.609742 run osmo-stp_10.42.42.5(pid=5421): Launched 00:55:52.726823 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:55:53.251307 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5423): Launched 00:55:53.367765 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:55:53.624421 run patchelf(pid=5424): Launched 00:55:53.793351 run osmo-stp_10.42.42.5(pid=5421): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5421)] 00:55:53.921864 run osmo-stp_10.42.42.5(pid=5421): stdout: | (launched: 2022-12-10_00:55:52.553885) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:55:54.051953 run osmo-stp_10.42.42.5(pid=5421): stderr: | 20221210005552722 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005552723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005552723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005552723 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005552724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005552724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005552724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:55:54.182118 run osmo-stp_10.42.42.5(pid=5421): stdout: | (launched: 2022-12-10_00:55:52.553885) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:55:54.306243 run osmo-stp_10.42.42.5(pid=5421): stderr: | 20221210005552722 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005552723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005552723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005552723 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005552724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005552724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005552724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:55:54.453662 run patchelf(pid=5424): Terminating (SIGINT) 00:55:54.623186 run patchelf(pid=5424): Terminated: ok {rc=0} 00:55:54.745469 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5421): Process ended prematurely: osmo-stp_10.42.42.5(pid=5421) [trial-2367↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5421)] [trial-2367↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 00:55:54.754878 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 00:55:54.782423 run osmo-hlr_10.42.42.2(pid=5418): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5418)] 00:55:54.830333 run osmo-hlr_10.42.42.2(pid=5418): stdout: | (launched: 2022-12-10_00:55:51.610607) 00:55:54.879885 run osmo-hlr_10.42.42.2(pid=5418): stderr: | 20221210005551788 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005551788 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005551789 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005551789 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005551789 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005551789 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005551802 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005551810 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005551811 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005551811 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:55:54.930035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5411): Terminating (SIGTERM) 00:55:54.970111 run iperf3-srv_10.42.42.10(pid=5412): Terminating (SIGTERM) 00:55:55.009953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5413): Terminating (SIGTERM) 00:55:55.049997 run iperf3-srv_10.42.42.10(pid=5414): Terminating (SIGTERM) 00:55:55.089663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5417): Terminating (SIGTERM) 00:55:55.129712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5420): Terminating (SIGTERM) 00:55:55.169502 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5423): Terminating (SIGTERM) 00:55:55.209590 --- ParallelTerminationStrategy: PID 5411 died... 00:55:55.228633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5411): Terminated: ok {rc=0} 00:55:55.273572 --- ParallelTerminationStrategy: PID 5412 died... 00:55:55.291952 run iperf3-srv_10.42.42.10(pid=5412): Terminated {rc=256} 00:55:55.336125 --- ParallelTerminationStrategy: PID 5413 died... 00:55:55.354561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5413): Terminated: ok {rc=0} 00:55:55.399187 --- ParallelTerminationStrategy: PID 5414 died... 00:55:55.418349 run iperf3-srv_10.42.42.10(pid=5414): Terminated {rc=256} 00:55:55.462740 --- ParallelTerminationStrategy: PID 5417 died... 00:55:55.481414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5417): Terminated: ok {rc=0} 00:55:55.525664 --- ParallelTerminationStrategy: PID 5420 died... 00:55:55.544233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5420): Terminated: ok {rc=0} 00:55:55.588304 --- ParallelTerminationStrategy: PID 5423 died... 00:55:55.606801 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5423): Terminated: ok {rc=0} 00:55:55.694770 bus /gobi_0: Setting Powered False 00:55:56.795187 bus /gobi_0: Setting Powered False 00:55:57.910954 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 00:55:59.060780 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:55:59.072676 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:55:59.133331 tst iperf3.py: using LAC 24864 00:55:59.261266 tst iperf3.py: using RAC 129 00:55:59.388690 tst iperf3.py: using CellId 24864 00:55:59.515691 tst iperf3.py: using BVCI 24865 00:55:59.633254 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:55:59.644379 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:55:59.655359 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:55:59.666499 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:55:59.677457 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:55:59.688326 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:55:59.699452 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:55:59.710369 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:55:59.721537 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:55:59.836919 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:56:00.040462 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:56:00.344351 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5425): Launched 00:56:00.609704 run iperf3-srv_10.42.42.10(pid=5426): Launched 00:56:00.724201 tst iperf3.py:8: start network... 00:56:00.935116 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:56:01.461194 run create_hlr_db(pid=5427): Launched 00:56:01.624554 bus /gobi_6: Setting Powered False 00:56:02.685108 run create_hlr_db(pid=5427): Terminated: ok {rc=0} 00:56:03.126262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5429): Launched 00:56:03.450867 run osmo-hlr_10.42.42.2(pid=5430): Launched 00:56:03.575846 run osmo-stp_10.42.42.5: Starting osmo-stp 00:56:04.138717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5445): Launched 00:56:04.462288 run osmo-stp_10.42.42.5(pid=5446): Launched 00:56:04.586987 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:56:05.143249 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5448): Launched 00:56:05.266945 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:56:05.539934 run patchelf(pid=5449): Launched 00:56:05.719503 run osmo-stp_10.42.42.5(pid=5446): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5446)] 00:56:05.855827 run osmo-stp_10.42.42.5(pid=5446): stdout: | (launched: 2022-12-10_00:56:04.403272) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:56:05.995034 run osmo-stp_10.42.42.5(pid=5446): stderr: | 20221210005604594 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005604594 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005604594 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005604595 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005604595 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005604595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005604595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:56:06.133434 run osmo-stp_10.42.42.5(pid=5446): stdout: | (launched: 2022-12-10_00:56:04.403272) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:56:06.266186 run osmo-stp_10.42.42.5(pid=5446): stderr: | 20221210005604594 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005604594 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005604594 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005604595 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005604595 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005604595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005604595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:56:06.423389 run patchelf(pid=5449): Terminating (SIGINT) 00:56:06.603355 run patchelf(pid=5449): Terminated: ok {rc=0} 00:56:06.733027 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5446): Process ended prematurely: osmo-stp_10.42.42.5(pid=5446) [trial-2367↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5446)] [trial-2367↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 00:56:06.743152 tst iperf3.py:8: Test FAILED (7.7 sec) 00:56:06.771362 run osmo-hlr_10.42.42.2(pid=5430): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5430)] 00:56:06.820858 run osmo-hlr_10.42.42.2(pid=5430): stdout: | (launched: 2022-12-10_00:56:03.391699) 00:56:06.872386 run osmo-hlr_10.42.42.2(pid=5430): stderr: | 20221210005603591 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005603591 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005603591 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005603591 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005603591 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005603591 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005603618 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005603630 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005603630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005603630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:56:06.924387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5425): Terminating (SIGTERM) 00:56:06.965923 run iperf3-srv_10.42.42.10(pid=5426): Terminating (SIGTERM) 00:56:07.007428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5429): Terminating (SIGTERM) 00:56:07.048786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5445): Terminating (SIGTERM) 00:56:07.090347 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5448): Terminating (SIGTERM) 00:56:07.131994 --- ParallelTerminationStrategy: PID 5425 died... 00:56:07.151784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5425): Terminated: ok {rc=0} 00:56:07.197395 --- ParallelTerminationStrategy: PID 5426 died... 00:56:07.216667 run iperf3-srv_10.42.42.10(pid=5426): Terminated {rc=256} 00:56:07.262291 --- ParallelTerminationStrategy: PID 5429 died... 00:56:07.281624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5429): Terminated: ok {rc=0} 00:56:07.327183 --- ParallelTerminationStrategy: PID 5445 died... 00:56:07.346744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5445): Terminated: ok {rc=0} 00:56:07.392483 --- ParallelTerminationStrategy: PID 5448 died... 00:56:07.412104 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5448): Terminated: ok {rc=0} 00:56:07.499754 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 00:56:08.651870 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:08.664005 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:56:08.721771 tst iperf3m4.py: using LAC 24865 00:56:08.848254 tst iperf3m4.py: using RAC 130 00:56:08.974979 tst iperf3m4.py: using CellId 24865 00:56:09.103690 tst iperf3m4.py: using BVCI 24866 00:56:09.222705 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:09.233982 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:09.244852 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:09.255957 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:09.266969 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:09.277965 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:09.289142 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:09.300144 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:09.311307 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:56:09.428795 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:56:09.549772 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:56:09.665413 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:56:09.785928 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:56:10.004503 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:56:10.328006 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5450): Launched 00:56:10.609469 run iperf3-srv_10.42.42.10(pid=5451): Launched 00:56:10.731795 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:56:10.950651 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:56:11.277469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5452): Launched 00:56:11.560297 run iperf3-srv_10.42.42.10(pid=5453): Launched 00:56:11.682317 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:56:11.899024 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:56:12.223300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5454): Launched 00:56:12.504457 run iperf3-srv_10.42.42.10(pid=5455): Launched 00:56:12.626013 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:56:12.842897 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:56:13.167467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5456): Launched 00:56:13.448786 run iperf3-srv_10.42.42.10(pid=5457): Launched 00:56:13.570814 tst iperf3m4.py:8: start network... 00:56:13.787568 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:56:14.289475 run create_hlr_db(pid=5458): Launched 00:56:14.421351 bus /gobi_6: Setting Powered False 00:56:15.485769 run create_hlr_db(pid=5458): Terminated: ok {rc=0} 00:56:15.930419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5460): Launched 00:56:16.265749 run osmo-hlr_10.42.42.2(pid=5461): Launched 00:56:16.503227 run osmo-stp_10.42.42.5: Starting osmo-stp 00:56:17.223561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5463): Launched 00:56:17.536848 run osmo-stp_10.42.42.5(pid=5464): Launched 00:56:17.655863 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:56:18.178675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5466): Launched 00:56:18.295037 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:56:18.551175 run patchelf(pid=5467): Launched 00:56:18.720325 run osmo-stp_10.42.42.5(pid=5464): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5464)] 00:56:18.848773 run osmo-stp_10.42.42.5(pid=5464): stdout: | (launched: 2022-12-10_00:56:17.480545) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:56:18.979066 run osmo-stp_10.42.42.5(pid=5464): stderr: | 20221210005617652 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005617652 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005617653 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005617653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005617653 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005617654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005617654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:56:19.109345 run osmo-stp_10.42.42.5(pid=5464): stdout: | (launched: 2022-12-10_00:56:17.480545) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:56:19.234073 run osmo-stp_10.42.42.5(pid=5464): stderr: | 20221210005617652 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005617652 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005617653 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005617653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005617653 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005617654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005617654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:56:19.381593 run patchelf(pid=5467): Terminating (SIGINT) 00:56:19.551321 run patchelf(pid=5467): Terminated: ok {rc=0} 00:56:19.674152 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5464): Process ended prematurely: osmo-stp_10.42.42.5(pid=5464) [trial-2367↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5464)] [trial-2367↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 00:56:19.683522 tst iperf3m4.py:8: Test FAILED (11.1 sec) 00:56:19.711707 run osmo-hlr_10.42.42.2(pid=5461): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5461)] 00:56:19.760679 run osmo-hlr_10.42.42.2(pid=5461): stdout: | (launched: 2022-12-10_00:56:16.195361) 00:56:19.810500 run osmo-hlr_10.42.42.2(pid=5461): stderr: | 20221210005616536 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005616536 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005616536 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005616536 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005616536 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005616536 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005616556 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005616564 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005616564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005616564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:56:19.860621 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5450): Terminating (SIGTERM) 00:56:19.900891 run iperf3-srv_10.42.42.10(pid=5451): Terminating (SIGTERM) 00:56:19.941059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5452): Terminating (SIGTERM) 00:56:19.981739 run iperf3-srv_10.42.42.10(pid=5453): Terminating (SIGTERM) 00:56:20.021433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5454): Terminating (SIGTERM) 00:56:20.061743 run iperf3-srv_10.42.42.10(pid=5455): Terminating (SIGTERM) 00:56:20.101215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5456): Terminating (SIGTERM) 00:56:20.141543 run iperf3-srv_10.42.42.10(pid=5457): Terminating (SIGTERM) 00:56:20.182027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5460): Terminating (SIGTERM) 00:56:20.227294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5463): Terminating (SIGTERM) 00:56:20.269355 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5466): Terminating (SIGTERM) 00:56:20.311813 --- ParallelTerminationStrategy: PID 5450 died... 00:56:20.331562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5450): Terminated: ok {rc=0} 00:56:20.379017 --- ParallelTerminationStrategy: PID 5451 died... 00:56:20.398296 run iperf3-srv_10.42.42.10(pid=5451): Terminated {rc=256} 00:56:20.444804 --- ParallelTerminationStrategy: PID 5452 died... 00:56:20.464598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5452): Terminated: ok {rc=0} 00:56:20.511421 --- ParallelTerminationStrategy: PID 5453 died... 00:56:20.530947 run iperf3-srv_10.42.42.10(pid=5453): Terminated {rc=256} 00:56:20.577546 --- ParallelTerminationStrategy: PID 5454 died... 00:56:20.597201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5454): Terminated: ok {rc=0} 00:56:20.643807 --- ParallelTerminationStrategy: PID 5455 died... 00:56:20.663023 run iperf3-srv_10.42.42.10(pid=5455): Terminated {rc=256} 00:56:20.709499 --- ParallelTerminationStrategy: PID 5456 died... 00:56:20.728600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5456): Terminated: ok {rc=0} 00:56:20.775293 --- ParallelTerminationStrategy: PID 5457 died... 00:56:20.794789 run iperf3-srv_10.42.42.10(pid=5457): Terminated {rc=256} 00:56:20.841326 --- ParallelTerminationStrategy: PID 5460 died... 00:56:20.860648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5460): Terminated: ok {rc=0} 00:56:20.907328 --- ParallelTerminationStrategy: PID 5463 died... 00:56:20.927034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5463): Terminated: ok {rc=0} 00:56:20.973591 --- ParallelTerminationStrategy: PID 5466 died... 00:56:20.993125 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5466): Terminated: ok {rc=0} 00:56:21.081909 bus /gobi_4: Setting Powered False 00:56:22.178082 bus /gobi_4: Setting Powered False 00:56:23.293970 bus /gobi_1: Setting Powered False 00:56:24.392317 bus /gobi_1: Setting Powered False 00:56:25.507381 bus /gobi_0: Setting Powered False 00:56:26.605270 bus /gobi_0: Setting Powered False 00:56:27.720795 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 00:56:28.823090 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:28.834766 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:56:28.892194 tst ping.py: using LAC 24866 00:56:29.016362 tst ping.py: using RAC 131 00:56:29.143078 tst ping.py: using CellId 24866 00:56:29.271371 tst ping.py: using BVCI 24867 00:56:29.381684 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:29.392394 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:29.403062 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:29.414038 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:29.424675 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:29.435359 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:29.446290 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:29.457481 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:56:29.569980 tst ping.py:19: start network... 00:56:29.769003 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:56:30.229526 run create_hlr_db(pid=5468): Launched 00:56:30.345257 bus /gobi_6: Setting Powered False 00:56:31.407387 run create_hlr_db(pid=5468): Terminated: ok {rc=0} 00:56:31.866421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5470): Launched 00:56:32.200877 run osmo-hlr_10.42.42.2(pid=5471): Launched 00:56:32.315993 run osmo-stp_10.42.42.5: Starting osmo-stp 00:56:32.842634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5473): Launched 00:56:33.138932 run osmo-stp_10.42.42.5(pid=5474): Launched 00:56:33.251658 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:56:33.769633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5476): Launched 00:56:33.884247 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:56:34.135927 run patchelf(pid=5477): Launched 00:56:34.301458 run osmo-stp_10.42.42.5(pid=5474): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5474)] 00:56:34.427011 run osmo-stp_10.42.42.5(pid=5474): stdout: | (launched: 2022-12-10_00:56:33.083960) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:56:34.554087 run osmo-stp_10.42.42.5(pid=5474): stderr: | 20221210005633255 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005633255 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005633255 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005633256 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005633256 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005633256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005633256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:56:34.682139 run osmo-stp_10.42.42.5(pid=5474): stdout: | (launched: 2022-12-10_00:56:33.083960) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:56:34.804157 run osmo-stp_10.42.42.5(pid=5474): stderr: | 20221210005633255 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005633255 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005633255 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005633256 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005633256 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005633256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005633256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:56:34.949458 run patchelf(pid=5477): Terminating (SIGINT) 00:56:35.115213 run patchelf(pid=5477): Terminated: ok {rc=0} 00:56:35.234611 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5474): Process ended prematurely: osmo-stp_10.42.42.5(pid=5474) [trial-2367↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5474)] [trial-2367↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 00:56:35.243466 tst ping.py:22: Test FAILED (6.4 sec) 00:56:35.270762 run osmo-hlr_10.42.42.2(pid=5471): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5471)] 00:56:35.318358 run osmo-hlr_10.42.42.2(pid=5471): stdout: | (launched: 2022-12-10_00:56:32.141528) 00:56:35.367714 run osmo-hlr_10.42.42.2(pid=5471): stderr: | 20221210005632319 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005632319 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005632319 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005632319 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005632319 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005632319 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005632335 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005632345 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005632346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005632346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:56:35.417588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5470): Terminating (SIGTERM) 00:56:35.457609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5473): Terminating (SIGTERM) 00:56:35.497646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5476): Terminating (SIGTERM) 00:56:35.537741 --- ParallelTerminationStrategy: PID 5470 died... 00:56:35.556742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5470): Terminated: ok {rc=0} 00:56:35.601281 --- ParallelTerminationStrategy: PID 5473 died... 00:56:35.619637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5473): Terminated: ok {rc=0} 00:56:35.663680 --- ParallelTerminationStrategy: PID 5476 died... 00:56:35.682100 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5476): Terminated: ok {rc=0} 00:56:35.767820 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 00:56:36.856869 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:36.868823 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:56:36.926360 tst ping_idle_ping.py: using LAC 24867 00:56:37.045220 tst ping_idle_ping.py: using RAC 132 00:56:37.161952 tst ping_idle_ping.py: using CellId 24867 00:56:37.281266 tst ping_idle_ping.py: using BVCI 24868 00:56:37.390762 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:37.401732 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:37.412409 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:37.423402 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:37.434216 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:37.444894 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:37.455925 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:37.466729 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:56:37.579933 tst ping_idle_ping.py:24: start network... 00:56:37.779691 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:56:38.242822 run create_hlr_db(pid=5478): Launched 00:56:38.356106 bus /gobi_6: Setting Powered False 00:56:39.415840 run create_hlr_db(pid=5478): Terminated: ok {rc=0} 00:56:39.851622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5480): Launched 00:56:40.171114 run osmo-hlr_10.42.42.2(pid=5481): Launched 00:56:40.292828 run osmo-stp_10.42.42.5: Starting osmo-stp 00:56:40.848072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5483): Launched 00:56:41.167317 run osmo-stp_10.42.42.5(pid=5484): Launched 00:56:41.289302 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:56:41.839990 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5486): Launched 00:56:41.962915 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:56:42.231372 run patchelf(pid=5487): Launched 00:56:42.408878 run osmo-stp_10.42.42.5(pid=5484): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5484)] 00:56:42.543508 run osmo-stp_10.42.42.5(pid=5484): stdout: | (launched: 2022-12-10_00:56:41.108692) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:56:42.680382 run osmo-stp_10.42.42.5(pid=5484): stderr: | 20221210005641303 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005641303 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005641303 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005641303 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005641304 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005641304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005641304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:56:42.816643 run osmo-stp_10.42.42.5(pid=5484): stdout: | (launched: 2022-12-10_00:56:41.108692) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:56:42.947609 run osmo-stp_10.42.42.5(pid=5484): stderr: | 20221210005641303 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005641303 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005641303 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005641303 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005641304 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005641304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005641304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:56:43.102992 run patchelf(pid=5487): Terminating (SIGINT) 00:56:43.280164 run patchelf(pid=5487): Terminated: ok {rc=0} 00:56:43.407850 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5484): Process ended prematurely: osmo-stp_10.42.42.5(pid=5484) [trial-2367↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5484)] [trial-2367↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 00:56:43.417397 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 00:56:43.445389 run osmo-hlr_10.42.42.2(pid=5481): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5481)] 00:56:43.495073 run osmo-hlr_10.42.42.2(pid=5481): stdout: | (launched: 2022-12-10_00:56:40.112656) 00:56:43.546569 run osmo-hlr_10.42.42.2(pid=5481): stderr: | 20221210005640313 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005640313 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005640313 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005640313 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005640313 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005640313 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005640326 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005640334 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005640334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005640334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:56:43.598571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5480): Terminating (SIGTERM) 00:56:43.640219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5483): Terminating (SIGTERM) 00:56:43.681890 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5486): Terminating (SIGTERM) 00:56:43.723674 --- ParallelTerminationStrategy: PID 5480 died... 00:56:43.743534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5480): Terminated: ok {rc=0} 00:56:43.789867 --- ParallelTerminationStrategy: PID 5483 died... 00:56:43.809437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5483): Terminated: ok {rc=0} 00:56:43.855257 --- ParallelTerminationStrategy: PID 5486 died... 00:56:43.874799 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5486): Terminated: ok {rc=0} 00:56:43.962957 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 00:56:45.265709 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:56:45.272521 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 00:56:45.293888 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 00:56:45.332640 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 00:56:45.419784 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 00:56:45.440706 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 00:56:45.479538 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 00:56:46.093591 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 00:56:46.146882 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:56:46.158953 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:56:46.220687 tst cs_paging_gprs_active.py: using LAC 24868 00:56:46.374615 tst cs_paging_gprs_active.py: using RAC 133 00:56:46.503066 tst cs_paging_gprs_active.py: using CellId 24868 00:56:46.630065 tst cs_paging_gprs_active.py: using BVCI 24869 00:56:46.751143 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:56:46.762997 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:56:46.774729 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:56:46.786463 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:56:46.798379 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:56:46.810407 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:56:46.822288 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:56:46.833945 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:56:46.847016 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:56:46.966368 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:56:47.108339 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:56:47.348753 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:56:47.673894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5491): Launched 00:56:47.955435 run iperf3-srv_10.42.42.10(pid=5492): Launched 00:56:48.077143 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:56:48.294113 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:56:48.617773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5493): Launched 00:56:48.898946 run iperf3-srv_10.42.42.10(pid=5494): Launched 00:56:49.020622 tst cs_paging_gprs_active.py:38: start network... 00:56:49.238109 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:56:49.739011 run create_hlr_db(pid=5495): Launched 00:56:49.871135 bus /gobi_6: Setting Powered False 00:56:50.934442 run create_hlr_db(pid=5495): Terminated: ok {rc=0} 00:56:51.383939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5497): Launched 00:56:51.707646 run osmo-hlr_10.42.42.2(pid=5498): Launched 00:56:51.831159 run osmo-stp_10.42.42.5: Starting osmo-stp 00:56:52.388563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5500): Launched 00:56:52.712931 run osmo-stp_10.42.42.5(pid=5501): Launched 00:56:52.836634 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:56:53.395909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5503): Launched 00:56:53.519873 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:56:53.793596 run patchelf(pid=5504): Launched 00:56:53.975653 run osmo-stp_10.42.42.5(pid=5501): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5501)] 00:56:54.113572 run osmo-stp_10.42.42.5(pid=5501): stdout: | (launched: 2022-12-10_00:56:52.653720) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:56:54.252386 run osmo-stp_10.42.42.5(pid=5501): stderr: | 20221210005652845 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005652845 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005652845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005652847 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005652849 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005652849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005652849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:56:54.391611 run osmo-stp_10.42.42.5(pid=5501): stdout: | (launched: 2022-12-10_00:56:52.653720) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:56:54.524692 run osmo-stp_10.42.42.5(pid=5501): stderr: | 20221210005652845 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005652845 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005652845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005652847 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005652849 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005652849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005652849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:56:54.682691 run patchelf(pid=5504): Terminating (SIGINT) 00:56:54.863885 run patchelf(pid=5504): Terminated: ok {rc=0} 00:56:54.994984 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5501): Process ended prematurely: osmo-stp_10.42.42.5(pid=5501) [trial-2367↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5501)] [trial-2367↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 00:56:55.005119 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 00:56:55.033523 run osmo-hlr_10.42.42.2(pid=5498): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5498)] 00:56:55.083318 run osmo-hlr_10.42.42.2(pid=5498): stdout: | (launched: 2022-12-10_00:56:51.648476) 00:56:55.134719 run osmo-hlr_10.42.42.2(pid=5498): stderr: | 20221210005651847 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005651847 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005651847 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005651847 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005651847 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005651847 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005651859 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005651868 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005651868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005651868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:56:55.186774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5491): Terminating (SIGTERM) 00:56:55.228427 run iperf3-srv_10.42.42.10(pid=5492): Terminating (SIGTERM) 00:56:55.270009 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5493): Terminating (SIGTERM) 00:56:55.311537 run iperf3-srv_10.42.42.10(pid=5494): Terminating (SIGTERM) 00:56:55.353138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5497): Terminating (SIGTERM) 00:56:55.394648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5500): Terminating (SIGTERM) 00:56:55.436046 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5503): Terminating (SIGTERM) 00:56:55.477724 --- ParallelTerminationStrategy: PID 5491 died... 00:56:55.497605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5491): Terminated: ok {rc=0} 00:56:55.543297 --- ParallelTerminationStrategy: PID 5492 died... 00:56:55.562568 run iperf3-srv_10.42.42.10(pid=5492): Terminated {rc=256} 00:56:55.607861 --- ParallelTerminationStrategy: PID 5493 died... 00:56:55.627102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5493): Terminated: ok {rc=0} 00:56:55.672750 --- ParallelTerminationStrategy: PID 5494 died... 00:56:55.692063 run iperf3-srv_10.42.42.10(pid=5494): Terminated {rc=256} 00:56:55.737540 --- ParallelTerminationStrategy: PID 5497 died... 00:56:55.756842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5497): Terminated: ok {rc=0} 00:56:55.802343 --- ParallelTerminationStrategy: PID 5500 died... 00:56:55.821607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5500): Terminated: ok {rc=0} 00:56:55.867081 --- ParallelTerminationStrategy: PID 5503 died... 00:56:55.886657 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5503): Terminated: ok {rc=0} 00:56:55.974444 bus /gobi_0: Setting Powered False 00:56:57.074272 bus /gobi_0: Setting Powered False 00:56:58.191582 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 00:56:59.337998 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:56:59.349723 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:56:59.412413 tst iperf3.py: using LAC 24869 00:56:59.530030 tst iperf3.py: using RAC 134 00:56:59.646379 tst iperf3.py: using CellId 24869 00:56:59.764475 tst iperf3.py: using BVCI 24870 00:56:59.873575 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:56:59.884286 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:56:59.894882 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:56:59.905765 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:56:59.916588 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:56:59.927340 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:56:59.938290 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:56:59.948899 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:56:59.959991 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:57:00.078901 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:57:00.297401 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:57:00.621444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5505): Launched 00:57:00.907771 run iperf3-srv_10.42.42.10(pid=5506): Launched 00:57:01.048318 tst iperf3.py:8: start network... 00:57:01.274579 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:57:01.788658 run create_hlr_db(pid=5507): Launched 00:57:01.956342 bus /gobi_6: Setting Powered False 00:57:03.020319 run create_hlr_db(pid=5507): Terminated: ok {rc=0} 00:57:03.452713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5509): Launched 00:57:03.757649 run osmo-hlr_10.42.42.2(pid=5510): Launched 00:57:03.879320 run osmo-stp_10.42.42.5: Starting osmo-stp 00:57:04.415282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5512): Launched 00:57:04.717729 run osmo-stp_10.42.42.5(pid=5513): Launched 00:57:04.833170 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:57:05.354082 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5515): Launched 00:57:05.469606 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:57:05.724333 run patchelf(pid=5516): Launched 00:57:05.892357 run osmo-stp_10.42.42.5(pid=5513): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5513)] 00:57:06.020741 run osmo-stp_10.42.42.5(pid=5513): stdout: | (launched: 2022-12-10_00:57:04.662172) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:57:06.150109 run osmo-stp_10.42.42.5(pid=5513): stderr: | 20221210005704831 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005704831 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005704831 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005704832 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005704832 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005704832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005704832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:57:06.279449 run osmo-stp_10.42.42.5(pid=5513): stdout: | (launched: 2022-12-10_00:57:04.662172) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:57:06.402966 run osmo-stp_10.42.42.5(pid=5513): stderr: | 20221210005704831 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005704831 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005704831 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005704832 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005704832 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005704832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005704832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:57:06.549656 run patchelf(pid=5516): Terminating (SIGINT) 00:57:06.717993 run patchelf(pid=5516): Terminated: ok {rc=0} 00:57:06.839896 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5513): Process ended prematurely: osmo-stp_10.42.42.5(pid=5513) [trial-2367↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5513)] [trial-2367↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 00:57:06.849556 tst iperf3.py:8: Test FAILED (7.5 sec) 00:57:06.876780 run osmo-hlr_10.42.42.2(pid=5510): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5510)] 00:57:06.925099 run osmo-hlr_10.42.42.2(pid=5510): stdout: | (launched: 2022-12-10_00:57:03.701615) 00:57:06.974256 run osmo-hlr_10.42.42.2(pid=5510): stderr: | 20221210005703881 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005703881 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005703882 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005703882 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005703882 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005703882 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005703894 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005703903 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005703903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005703904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:57:07.024207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5505): Terminating (SIGTERM) 00:57:07.064066 run iperf3-srv_10.42.42.10(pid=5506): Terminating (SIGTERM) 00:57:07.103828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5509): Terminating (SIGTERM) 00:57:07.143664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5512): Terminating (SIGTERM) 00:57:07.183558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5515): Terminating (SIGTERM) 00:57:07.223395 --- ParallelTerminationStrategy: PID 5505 died... 00:57:07.242269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5505): Terminated: ok {rc=0} 00:57:07.286476 --- ParallelTerminationStrategy: PID 5506 died... 00:57:07.304893 run iperf3-srv_10.42.42.10(pid=5506): Terminated {rc=256} 00:57:07.348670 --- ParallelTerminationStrategy: PID 5509 died... 00:57:07.367105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5509): Terminated: ok {rc=0} 00:57:07.410756 --- ParallelTerminationStrategy: PID 5512 died... 00:57:07.429097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5512): Terminated: ok {rc=0} 00:57:07.472625 --- ParallelTerminationStrategy: PID 5515 died... 00:57:07.491109 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5515): Terminated: ok {rc=0} 00:57:07.576523 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 00:57:08.729147 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:08.741250 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:57:08.802676 tst iperf3m4.py: using LAC 24870 00:57:08.931278 tst iperf3m4.py: using RAC 135 00:57:09.061197 tst iperf3m4.py: using CellId 24870 00:57:09.188671 tst iperf3m4.py: using BVCI 24871 00:57:09.306687 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:09.318105 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:09.329227 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:09.340752 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:09.352645 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:09.364124 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:09.375929 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:09.387749 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:09.399573 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:57:09.521608 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:57:09.644037 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:57:09.763978 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:57:09.884353 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:57:10.104371 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:57:10.429381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5517): Launched 00:57:10.712360 run iperf3-srv_10.42.42.10(pid=5518): Launched 00:57:10.834777 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:57:11.053008 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:57:11.377467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5519): Launched 00:57:11.659544 run iperf3-srv_10.42.42.10(pid=5520): Launched 00:57:11.781297 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:57:11.998876 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:57:12.323923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5521): Launched 00:57:12.605760 run iperf3-srv_10.42.42.10(pid=5522): Launched 00:57:12.727152 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:57:12.944024 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:57:13.268029 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5523): Launched 00:57:13.550055 run iperf3-srv_10.42.42.10(pid=5524): Launched 00:57:13.671171 tst iperf3m4.py:8: start network... 00:57:13.887920 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:57:14.391555 run create_hlr_db(pid=5525): Launched 00:57:14.523014 bus /gobi_6: Setting Powered False 00:57:15.586939 run create_hlr_db(pid=5525): Terminated: ok {rc=0} 00:57:16.077452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5527): Launched 00:57:16.413749 run osmo-hlr_10.42.42.2(pid=5528): Launched 00:57:16.635602 run osmo-stp_10.42.42.5: Starting osmo-stp 00:57:17.272821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5530): Launched 00:57:17.606642 run osmo-stp_10.42.42.5(pid=5531): Launched 00:57:17.730070 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:57:18.288763 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5533): Launched 00:57:18.412773 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:57:18.685500 run patchelf(pid=5534): Launched 00:57:18.866114 run osmo-stp_10.42.42.5(pid=5531): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5531)] 00:57:19.003361 run osmo-stp_10.42.42.5(pid=5531): stdout: | (launched: 2022-12-10_00:57:17.547035) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:57:19.142156 run osmo-stp_10.42.42.5(pid=5531): stderr: | 20221210005717744 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005717744 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005717744 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005717744 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005717745 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005717745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005717745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:57:19.280738 run osmo-stp_10.42.42.5(pid=5531): stdout: | (launched: 2022-12-10_00:57:17.547035) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:57:19.413994 run osmo-stp_10.42.42.5(pid=5531): stderr: | 20221210005717744 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005717744 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005717744 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005717744 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005717745 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005717745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005717745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:57:19.571895 run patchelf(pid=5534): Terminating (SIGINT) 00:57:19.752400 run patchelf(pid=5534): Terminated: ok {rc=0} 00:57:19.882477 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5531): Process ended prematurely: osmo-stp_10.42.42.5(pid=5531) [trial-2367↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5531)] [trial-2367↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 00:57:19.892507 tst iperf3m4.py:8: Test FAILED (11.2 sec) 00:57:19.921186 run osmo-hlr_10.42.42.2(pid=5528): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5528)] 00:57:19.971628 run osmo-hlr_10.42.42.2(pid=5528): stdout: | (launched: 2022-12-10_00:57:16.344737) 00:57:20.023307 run osmo-hlr_10.42.42.2(pid=5528): stderr: | 20221210005716568 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005716568 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005716568 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005716568 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005716568 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005716568 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005716584 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005716608 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005716608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005716608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:57:20.075538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5517): Terminating (SIGTERM) 00:57:20.117654 run iperf3-srv_10.42.42.10(pid=5518): Terminating (SIGTERM) 00:57:20.159377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5519): Terminating (SIGTERM) 00:57:20.201352 run iperf3-srv_10.42.42.10(pid=5520): Terminating (SIGTERM) 00:57:20.242946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5521): Terminating (SIGTERM) 00:57:20.285095 run iperf3-srv_10.42.42.10(pid=5522): Terminating (SIGTERM) 00:57:20.326574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5523): Terminating (SIGTERM) 00:57:20.368242 run iperf3-srv_10.42.42.10(pid=5524): Terminating (SIGTERM) 00:57:20.409706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5527): Terminating (SIGTERM) 00:57:20.452123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5530): Terminating (SIGTERM) 00:57:20.494026 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5533): Terminating (SIGTERM) 00:57:20.535895 --- ParallelTerminationStrategy: PID 5517 died... 00:57:20.555838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5517): Terminated: ok {rc=0} 00:57:20.602206 --- ParallelTerminationStrategy: PID 5518 died... 00:57:20.621656 run iperf3-srv_10.42.42.10(pid=5518): Terminated {rc=256} 00:57:20.667651 --- ParallelTerminationStrategy: PID 5519 died... 00:57:20.687119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5519): Terminated: ok {rc=0} 00:57:20.733047 --- ParallelTerminationStrategy: PID 5520 died... 00:57:20.752433 run iperf3-srv_10.42.42.10(pid=5520): Terminated {rc=256} 00:57:20.798164 --- ParallelTerminationStrategy: PID 5521 died... 00:57:20.817710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5521): Terminated: ok {rc=0} 00:57:20.863498 --- ParallelTerminationStrategy: PID 5522 died... 00:57:20.882860 run iperf3-srv_10.42.42.10(pid=5522): Terminated {rc=256} 00:57:20.928587 --- ParallelTerminationStrategy: PID 5523 died... 00:57:20.948091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5523): Terminated: ok {rc=0} 00:57:20.994147 --- ParallelTerminationStrategy: PID 5524 died... 00:57:21.013774 run iperf3-srv_10.42.42.10(pid=5524): Terminated {rc=256} 00:57:21.059642 --- ParallelTerminationStrategy: PID 5527 died... 00:57:21.079196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5527): Terminated: ok {rc=0} 00:57:21.125344 --- ParallelTerminationStrategy: PID 5530 died... 00:57:21.144892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5530): Terminated: ok {rc=0} 00:57:21.191062 --- ParallelTerminationStrategy: PID 5533 died... 00:57:21.210712 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5533): Terminated: ok {rc=0} 00:57:21.298532 bus /gobi_4: Setting Powered False 00:57:22.397595 bus /gobi_4: Setting Powered False 00:57:23.515827 bus /gobi_1: Setting Powered False 00:57:24.614687 bus /gobi_1: Setting Powered False 00:57:25.730941 bus /gobi_0: Setting Powered False 00:57:26.829988 bus /gobi_0: Setting Powered False 00:57:27.949736 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 00:57:29.052762 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:29.064386 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:57:29.122395 tst ping.py: using LAC 24871 00:57:29.244762 tst ping.py: using RAC 136 00:57:29.369347 tst ping.py: using CellId 24871 00:57:29.492875 tst ping.py: using BVCI 24872 00:57:29.608368 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:29.619707 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:29.630908 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:29.642013 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:29.652942 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:29.663964 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:29.675177 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:29.686285 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:57:29.798755 tst ping.py:19: start network... 00:57:29.996264 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:57:30.454764 run create_hlr_db(pid=5535): Launched 00:57:30.568420 bus /gobi_6: Setting Powered False 00:57:31.643048 run create_hlr_db(pid=5535): Terminated: ok {rc=0} 00:57:32.159893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5537): Launched 00:57:32.481346 run osmo-hlr_10.42.42.2(pid=5538): Launched 00:57:32.604594 run osmo-stp_10.42.42.5: Starting osmo-stp 00:57:33.155748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5540): Launched 00:57:33.473483 run osmo-stp_10.42.42.5(pid=5541): Launched 00:57:33.594976 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:57:34.144598 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5543): Launched 00:57:34.266675 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:57:34.534602 run patchelf(pid=5544): Launched 00:57:34.711274 run osmo-stp_10.42.42.5(pid=5541): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5541)] 00:57:34.845030 run osmo-stp_10.42.42.5(pid=5541): stdout: | (launched: 2022-12-10_00:57:33.415356) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:57:34.980868 run osmo-stp_10.42.42.5(pid=5541): stderr: | 20221210005733609 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005733609 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005733609 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005733610 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005733610 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005733610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005733610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:57:35.116746 run osmo-stp_10.42.42.5(pid=5541): stdout: | (launched: 2022-12-10_00:57:33.415356) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:57:35.247155 run osmo-stp_10.42.42.5(pid=5541): stderr: | 20221210005733609 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005733609 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005733609 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005733610 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005733610 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005733610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005733610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:57:35.401337 run patchelf(pid=5544): Terminating (SIGINT) 00:57:35.577901 run patchelf(pid=5544): Terminated: ok {rc=0} 00:57:35.705493 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5541): Process ended prematurely: osmo-stp_10.42.42.5(pid=5541) [trial-2367↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5541)] [trial-2367↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 00:57:35.714985 tst ping.py:22: Test FAILED (6.7 sec) 00:57:35.743100 run osmo-hlr_10.42.42.2(pid=5538): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5538)] 00:57:35.793846 run osmo-hlr_10.42.42.2(pid=5538): stdout: | (launched: 2022-12-10_00:57:32.422899) 00:57:35.846075 run osmo-hlr_10.42.42.2(pid=5538): stderr: | 20221210005732622 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005732622 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005732622 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005732622 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005732622 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005732622 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005732634 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005732642 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005732642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005732642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:57:35.898608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5537): Terminating (SIGTERM) 00:57:35.941146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5540): Terminating (SIGTERM) 00:57:35.983371 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5543): Terminating (SIGTERM) 00:57:36.025769 --- ParallelTerminationStrategy: PID 5537 died... 00:57:36.045886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5537): Terminated: ok {rc=0} 00:57:36.092275 --- ParallelTerminationStrategy: PID 5540 died... 00:57:36.112023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5540): Terminated: ok {rc=0} 00:57:36.157858 --- ParallelTerminationStrategy: PID 5543 died... 00:57:36.177495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5543): Terminated: ok {rc=0} 00:57:36.265924 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 00:57:37.354773 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:37.367517 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:57:37.427902 tst ping_idle_ping.py: using LAC 24872 00:57:37.554948 tst ping_idle_ping.py: using RAC 137 00:57:37.679812 tst ping_idle_ping.py: using CellId 24872 00:57:37.806000 tst ping_idle_ping.py: using BVCI 24873 00:57:37.923102 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:37.934581 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:37.945639 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:37.956816 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:37.968187 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:37.979263 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:37.990590 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:38.001667 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:57:38.116213 tst ping_idle_ping.py:24: start network... 00:57:38.317290 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:57:38.786680 run create_hlr_db(pid=5549): Launched 00:57:38.902950 bus /gobi_6: Setting Powered False 00:57:39.966650 run create_hlr_db(pid=5549): Terminated: ok {rc=0} 00:57:40.411110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5551): Launched 00:57:40.729916 run osmo-hlr_10.42.42.2(pid=5552): Launched 00:57:40.850731 run osmo-stp_10.42.42.5: Starting osmo-stp 00:57:41.403235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5554): Launched 00:57:41.722557 run osmo-stp_10.42.42.5(pid=5555): Launched 00:57:41.843788 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:57:42.393358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5557): Launched 00:57:42.515229 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:57:42.783571 run patchelf(pid=5558): Launched 00:57:42.960609 run osmo-stp_10.42.42.5(pid=5555): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5555)] 00:57:43.095367 run osmo-stp_10.42.42.5(pid=5555): stdout: | (launched: 2022-12-10_00:57:41.663999) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:57:43.231646 run osmo-stp_10.42.42.5(pid=5555): stderr: | 20221210005741856 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005741856 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005741856 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005741856 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005741857 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005741857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005741857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:57:43.367396 run osmo-stp_10.42.42.5(pid=5555): stdout: | (launched: 2022-12-10_00:57:41.663999) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:57:43.498074 run osmo-stp_10.42.42.5(pid=5555): stderr: | 20221210005741856 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005741856 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005741856 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005741856 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005741857 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005741857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005741857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:57:43.652630 run patchelf(pid=5558): Terminating (SIGINT) 00:57:43.829324 run patchelf(pid=5558): Terminated: ok {rc=0} 00:57:43.956895 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5555): Process ended prematurely: osmo-stp_10.42.42.5(pid=5555) [trial-2367↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5555)] [trial-2367↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 00:57:43.966927 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 00:57:43.994559 run osmo-hlr_10.42.42.2(pid=5552): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5552)] 00:57:44.044253 run osmo-hlr_10.42.42.2(pid=5552): stdout: | (launched: 2022-12-10_00:57:40.671742) 00:57:44.095727 run osmo-hlr_10.42.42.2(pid=5552): stderr: | 20221210005740869 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005740869 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005740869 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005740869 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005740869 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005740869 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005740882 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005740890 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005740891 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005740891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:57:44.148136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5551): Terminating (SIGTERM) 00:57:44.190452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5554): Terminating (SIGTERM) 00:57:44.232551 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5557): Terminating (SIGTERM) 00:57:44.275351 --- ParallelTerminationStrategy: PID 5551 died... 00:57:44.295459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5551): Terminated: ok {rc=0} 00:57:44.341682 --- ParallelTerminationStrategy: PID 5554 died... 00:57:44.360835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5554): Terminated: ok {rc=0} 00:57:44.406618 --- ParallelTerminationStrategy: PID 5557 died... 00:57:44.426054 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5557): Terminated: ok {rc=0} 00:57:44.512780 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 00:57:45.802358 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:57:45.809333 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 00:57:45.842407 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 00:57:45.884628 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 00:57:45.945542 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 00:57:45.971884 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 00:57:46.008102 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 00:57:46.557652 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2367 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 00:57:46.563541 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:57:46.579247 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:57:46.648282 tst switch_tch_pdch.py: using LAC 24873 00:57:46.799563 tst switch_tch_pdch.py: using RAC 138 00:57:46.927223 tst switch_tch_pdch.py: using CellId 24873 00:57:47.044708 tst switch_tch_pdch.py: using BVCI 24874 00:57:47.155353 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:57:47.167491 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:57:47.179480 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:57:47.192351 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:57:47.206307 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:57:47.218344 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:57:47.231116 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:57:47.243835 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:57:47.363388 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:57:47.478634 tst switch_tch_pdch.py:51: start network... 00:57:47.678121 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:57:48.139999 run create_hlr_db(pid=5562): Launched 00:57:48.254441 bus /gobi_6: Setting Powered False 00:57:49.313728 run create_hlr_db(pid=5562): Terminated: ok {rc=0} 00:57:49.729316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5564): Launched 00:57:50.027822 run osmo-hlr_10.42.42.2(pid=5565): Launched 00:57:50.141974 run osmo-stp_10.42.42.5: Starting osmo-stp 00:57:50.666523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5567): Launched 00:57:50.963617 run osmo-stp_10.42.42.5(pid=5568): Launched 00:57:51.077678 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:57:51.590038 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5570): Launched 00:57:51.704089 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:57:51.954360 run patchelf(pid=5571): Launched 00:57:52.119225 run osmo-stp_10.42.42.5(pid=5568): ERR: Terminated: ERROR {rc=1} [trial-2367↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5568)] 00:57:52.244891 run osmo-stp_10.42.42.5(pid=5568): stdout: | (launched: 2022-12-10_00:57:50.909087) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:57:52.372855 run osmo-stp_10.42.42.5(pid=5568): stderr: | 20221210005751078 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005751078 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005751078 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005751078 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005751079 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005751079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005751079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:57:52.500212 run osmo-stp_10.42.42.5(pid=5568): stdout: | (launched: 2022-12-10_00:57:50.909087) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:57:52.622492 run osmo-stp_10.42.42.5(pid=5568): stderr: | 20221210005751078 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005751078 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005751078 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005751078 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005751079 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005751079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005751079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:57:52.767092 run patchelf(pid=5571): Terminating (SIGINT) 00:57:52.933389 run patchelf(pid=5571): Terminated: ok {rc=0} 00:57:53.053019 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=5568): Process ended prematurely: osmo-stp_10.42.42.5(pid=5568) [trial-2367↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5568)] [trial-2367↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 00:57:53.062100 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 00:57:53.088922 run osmo-hlr_10.42.42.2(pid=5565): ERR: Terminated: ERROR {rc=237} [trial-2367↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5565)] 00:57:53.137060 run osmo-hlr_10.42.42.2(pid=5565): stdout: | (launched: 2022-12-10_00:57:49.972557) 00:57:53.186630 run osmo-hlr_10.42.42.2(pid=5565): stderr: | 20221210005750146 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005750146 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005750146 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005750146 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005750146 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005750146 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005750158 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005750167 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005750167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005750167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:57:53.236569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5564): Terminating (SIGTERM) 00:57:53.276433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5567): Terminating (SIGTERM) 00:57:53.316346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5570): Terminating (SIGTERM) 00:57:53.356457 --- ParallelTerminationStrategy: PID 5564 died... 00:57:53.375412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5564): Terminated: ok {rc=0} 00:57:53.419680 --- ParallelTerminationStrategy: PID 5567 died... 00:57:53.438310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5567): Terminated: ok {rc=0} 00:57:53.482159 --- ParallelTerminationStrategy: PID 5570 died... 00:57:53.500524 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5570): Terminated: ok {rc=0} 00:57:53.586857 bus /gobi_0: Setting Powered False 00:57:54.687160 bus /gobi_0: Setting Powered False 00:57:55.803228 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 00:57:57.037740 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:57:57.043317 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 00:57:57.064131 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 00:57:57.098912 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 00:57:57.151075 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 00:57:57.171432 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 00:57:57.205701 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 00:57:57.760096 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2367 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 00:57:57.765170 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:57:57.775934 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 00:57:57.832379 tst switch_tch_pdch.py: using LAC 24874 00:57:57.952371 tst switch_tch_pdch.py: using RAC 139 00:57:58.077343 tst switch_tch_pdch.py: using CellId 24874 00:57:58.194553 tst switch_tch_pdch.py: using BVCI 24875 00:57:58.303216 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:57:58.314141 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:57:58.324716 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:57:58.336007 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:57:58.347252 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:57:58.358452 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:57:58.369954 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:57:58.381495 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 00:57:58.499773 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 00:57:58.620089 tst switch_tch_pdch.py:51: start network... 00:57:58.834524 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:57:59.299364 run create_hlr_db(pid=5575): Launched 00:57:59.429960 bus /gobi_6: Setting Powered False 00:58:00.493904 run create_hlr_db(pid=5575): Terminated: ok {rc=0} 00:58:00.935851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5577): Launched 00:58:01.264186 run osmo-hlr_10.42.42.2(pid=5578): Launched 00:58:01.501658 run osmo-stp_10.42.42.5: Starting osmo-stp 00:58:02.106225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5580): Launched 00:58:02.421437 run osmo-stp_10.42.42.5(pid=5581): Launched 00:58:02.538426 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:58:03.029128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5583): Launched 00:58:03.143101 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:58:03.393964 run patchelf(pid=5584): Launched 00:58:03.559347 run osmo-stp_10.42.42.5(pid=5581): ERR: Terminated: ERROR {rc=1} [trial-2367↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5581)] 00:58:03.684894 run osmo-stp_10.42.42.5(pid=5581): stdout: | (launched: 2022-12-10_00:58:02.366490) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:58:03.811897 run osmo-stp_10.42.42.5(pid=5581): stderr: | 20221210005802534 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005802534 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005802535 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005802535 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005802535 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005802536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005802536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:58:03.939529 run osmo-stp_10.42.42.5(pid=5581): stdout: | (launched: 2022-12-10_00:58:02.366490) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:58:04.062117 run osmo-stp_10.42.42.5(pid=5581): stderr: | 20221210005802534 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005802534 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005802535 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005802535 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005802535 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005802536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005802536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:58:04.206849 run patchelf(pid=5584): Terminating (SIGINT) 00:58:04.372675 run patchelf(pid=5584): Terminated: ok {rc=0} 00:58:04.492735 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=5581): Process ended prematurely: osmo-stp_10.42.42.5(pid=5581) [trial-2367↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5581)] [trial-2367↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 00:58:04.501764 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 00:58:04.528767 run osmo-hlr_10.42.42.2(pid=5578): ERR: Terminated: ERROR {rc=237} [trial-2367↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5578)] 00:58:04.576782 run osmo-hlr_10.42.42.2(pid=5578): stdout: | (launched: 2022-12-10_00:58:01.200230) 00:58:04.626487 run osmo-hlr_10.42.42.2(pid=5578): stderr: | 20221210005801543 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005801544 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005801544 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005801544 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005801544 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005801544 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005801563 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005801579 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005801579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005801579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:58:04.677462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5577): Terminating (SIGTERM) 00:58:04.717828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5580): Terminating (SIGTERM) 00:58:04.757996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5583): Terminating (SIGTERM) 00:58:04.798148 --- ParallelTerminationStrategy: PID 5577 died... 00:58:04.817266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5577): Terminated: ok {rc=0} 00:58:04.861511 --- ParallelTerminationStrategy: PID 5580 died... 00:58:04.879824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5580): Terminated: ok {rc=0} 00:58:04.923964 --- ParallelTerminationStrategy: PID 5583 died... 00:58:04.942477 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5583): Terminated: ok {rc=0} 00:58:05.025880 bus /gobi_0: Setting Powered False 00:58:06.124608 bus /gobi_0: Setting Powered False 00:58:07.240791 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 nitb_sms:trx-b200 --------------------------------------------------------------------- 00:58:08.477324 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:58:08.481574 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 00:58:08.515483 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 00:58:08.522524 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 00:58:08.575483 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 00:58:08.609664 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 00:58:08.616599 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 00:58:09.157869 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 00:58:09.164009 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 00:58:09.175985 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 00:58:09.227123 tst mo_mt_sms.py: using LAC 24875 00:58:09.343904 tst mo_mt_sms.py: using RAC 140 00:58:09.459853 tst mo_mt_sms.py: using CellId 24875 00:58:09.575798 tst mo_mt_sms.py: using BVCI 24876 00:58:09.693305 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 00:58:09.808201 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 00:58:09.924522 tst mo_mt_sms.py:9: start nitb and bts... 00:58:10.140607 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:58:10.792597 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5588): Launched 00:58:11.112046 run osmo-nitb_10.42.42.2(pid=5589): Launched 00:58:11.288535 run osmo-nitb_10.42.42.2(pid=5589): ERR: Terminated: ERROR {rc=2} [trial-2367↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5589)] 00:58:11.431777 run osmo-nitb_10.42.42.2(pid=5589): stdout: | (launched: 2022-12-10_00:58:11.053743) 00:58:11.576302 run osmo-nitb_10.42.42.2(pid=5589): stderr: | (launched: 2022-12-10_00:58:11.101270) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:58:11.720547 run osmo-nitb_10.42.42.2(pid=5589): stdout: | (launched: 2022-12-10_00:58:11.053743) 00:58:11.859332 run osmo-nitb_10.42.42.2(pid=5589): stderr: | (launched: 2022-12-10_00:58:11.101270) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=5589): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5589) [trial-2367↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5589)] 00:58:12.233068 tst osmo-nitb_10.42.42.2(pid=5589): stdout: | (launched: 2022-12-10_00:58:11.053743) 00:58:12.362901 tst osmo-nitb_10.42.42.2(pid=5589): stderr: | (launched: 2022-12-10_00:58:11.101270) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:58:12.515398 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=5589): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5589) [trial-2367↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5589)] [trial-2367↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 00:58:12.524267 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 00:58:12.531506 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5588): Terminating (SIGTERM) 00:58:12.742428 --- ParallelTerminationStrategy: PID 5588 died... 00:58:12.764237 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5588): Terminated: ok {rc=0} 00:58:12.852276 bus /sierra_3: Setting Powered False 00:58:13.953834 bus /sierra_3: Setting Powered False 00:58:15.072049 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 sms:trx-b200 --------------------------------------------------------------------- 00:58:16.270626 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:58:16.275041 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 00:58:16.311056 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 00:58:16.340492 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 00:58:16.392599 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 00:58:16.428090 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 00:58:16.458133 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 00:58:17.033209 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 00:58:17.039598 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 00:58:17.055044 tst sms:trx-b200: Using 1 x bts (candidates: 1) 00:58:17.120763 tst mo_mt_sms.py: using LAC 24876 00:58:17.254427 tst mo_mt_sms.py: using RAC 141 00:58:17.377217 tst mo_mt_sms.py: using CellId 24876 00:58:17.502818 tst mo_mt_sms.py: using BVCI 24877 00:58:17.619090 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 00:58:17.630134 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 00:58:17.640880 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 00:58:17.651707 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 00:58:17.662546 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 00:58:17.673778 tst sms:trx-b200: Using 1 x modem (candidates: 2) 00:58:17.788101 tst sms:trx-b200: Using 1 x modem (candidates: 2) 00:58:17.907187 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:58:18.401496 run create_hlr_db(pid=5593): Launched 00:58:18.531399 bus /sierra_2: Setting Powered False 00:58:19.594422 run create_hlr_db(pid=5593): Terminated: ok {rc=0} 00:58:20.020034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5595): Launched 00:58:20.319534 run osmo-hlr_10.42.42.2(pid=5596): Launched 00:58:20.434261 run osmo-stp_10.42.42.5: Starting osmo-stp 00:58:20.961595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5598): Launched 00:58:21.261184 run osmo-stp_10.42.42.5(pid=5599): Launched 00:58:21.374789 run osmo-msc_10.42.42.6: Starting osmo-msc 00:58:21.911811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5601): Launched 00:58:22.209730 run osmo-msc_10.42.42.6(pid=5602): Launched 00:58:22.375662 run osmo-stp_10.42.42.5(pid=5599): ERR: Terminated: ERROR {rc=1} [trial-2367↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5599)] 00:58:22.502212 run osmo-stp_10.42.42.5(pid=5599): stdout: | (launched: 2022-12-10_00:58:21.205730) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:58:22.629191 run osmo-stp_10.42.42.5(pid=5599): stderr: | 20221210005821374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005821374 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005821374 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005821375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005821375 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005821375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005821375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:58:22.753659 run osmo-stp_10.42.42.5(pid=5599): stdout: | (launched: 2022-12-10_00:58:21.205730) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:58:22.871492 run osmo-stp_10.42.42.5(pid=5599): stderr: | 20221210005821374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005821374 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005821374 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005821375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005821375 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005821375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005821375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:58:23.012826 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=5599): Process ended prematurely: osmo-stp_10.42.42.5(pid=5599) [trial-2367↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5599)] [trial-2367↪sms:trx-b200↪mo_mt_sms.py:16] 00:58:23.021315 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 00:58:23.047777 run osmo-hlr_10.42.42.2(pid=5596): ERR: Terminated: ERROR {rc=237} [trial-2367↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5596)] 00:58:23.095615 run osmo-hlr_10.42.42.2(pid=5596): stdout: | (launched: 2022-12-10_00:58:20.264549) 00:58:23.145238 run osmo-hlr_10.42.42.2(pid=5596): stderr: | 20221210005820439 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005820439 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005820439 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005820439 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005820439 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005820439 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005820454 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005820465 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005820465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005820465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:58:23.213943 run osmo-msc_10.42.42.6(pid=5602): ERR: Terminated: ERROR {rc=2} [trial-2367↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5602)] 00:58:23.261599 run osmo-msc_10.42.42.6(pid=5602): stdout: | (launched: 2022-12-10_00:58:22.155171) 00:58:23.310897 run osmo-msc_10.42.42.6(pid=5602): stderr: | 20221210005822427 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210005822427 DLGLOBAL DEBUG validating counter group 0x7fa333825c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210005822427 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210005822427 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210005822428 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210005822428 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210005822430 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210005822430 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210005822430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210005822430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:58:23.360462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5595): Terminating (SIGTERM) 00:58:23.399951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5598): Terminating (SIGTERM) 00:58:23.439667 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5601): Terminating (SIGTERM) 00:58:23.479284 --- ParallelTerminationStrategy: PID 5595 died... 00:58:23.498555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5595): Terminated: ok {rc=0} 00:58:23.542988 --- ParallelTerminationStrategy: PID 5598 died... 00:58:23.561502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5598): Terminated: ok {rc=0} 00:58:23.605349 --- ParallelTerminationStrategy: PID 5601 died... 00:58:23.623834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5601): Terminated: ok {rc=0} 00:58:23.709025 bus /sierra_3: Setting Powered False 00:58:24.808473 bus /sierra_3: Setting Powered False 00:58:25.924349 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 nitb_ussd:trx-b200 --------------------------------------------------------------------- 00:58:27.157538 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:58:27.161703 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 00:58:27.195968 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 00:58:27.203070 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 00:58:27.239018 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 00:58:27.273210 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 00:58:27.280300 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 00:58:27.800386 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2367 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 00:58:27.805856 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 00:58:27.817102 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 00:58:27.866331 tst assert_extension.py: using LAC 24877 00:58:27.990647 tst assert_extension.py: using RAC 142 00:58:28.119743 tst assert_extension.py: using CellId 24877 00:58:28.257720 tst assert_extension.py: using BVCI 24878 00:58:28.374775 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 00:58:28.487953 tst assert_extension.py:10: start nitb and bts... 00:58:28.686986 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:58:29.293359 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5607): Launched 00:58:29.613353 run osmo-nitb_10.42.42.2(pid=5608): Launched 00:58:29.790807 run osmo-nitb_10.42.42.2(pid=5608): ERR: Terminated: ERROR {rc=2} [trial-2367↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5608)] 00:58:29.934474 run osmo-nitb_10.42.42.2(pid=5608): stdout: | (launched: 2022-12-10_00:58:29.554617) 00:58:30.079299 run osmo-nitb_10.42.42.2(pid=5608): stderr: | (launched: 2022-12-10_00:58:29.602441) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:58:30.224125 run osmo-nitb_10.42.42.2(pid=5608): stdout: | (launched: 2022-12-10_00:58:29.554617) 00:58:30.363293 run osmo-nitb_10.42.42.2(pid=5608): stderr: | (launched: 2022-12-10_00:58:29.602441) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=5608): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5608) [trial-2367↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5608)] 00:58:30.734791 tst osmo-nitb_10.42.42.2(pid=5608): stdout: | (launched: 2022-12-10_00:58:29.554617) 00:58:30.870591 tst osmo-nitb_10.42.42.2(pid=5608): stderr: | (launched: 2022-12-10_00:58:29.602441) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:58:31.040188 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=5608): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5608) [trial-2367↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5608)] [trial-2367↪nitb_ussd:trx-b200↪assert_extension.py:12] 00:58:31.050952 tst assert_extension.py:12: Test FAILED (3.2 sec) 00:58:31.060612 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5607): Terminating (SIGTERM) 00:58:31.272865 --- ParallelTerminationStrategy: PID 5607 died... 00:58:31.298330 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5607): Terminated: ok {rc=0} 00:58:31.406913 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 ussd:trx-b200 --------------------------------------------------------------------- 00:58:32.593712 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:58:32.597712 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 00:58:32.631434 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 00:58:32.658508 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 00:58:32.693607 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 00:58:32.727120 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 00:58:32.753580 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 00:58:33.280809 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2367 ussd:trx-b200 assert_extension.py ---------------------------------------------- 00:58:33.286005 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 00:58:33.296575 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 00:58:33.349348 tst assert_extension.py: using LAC 24878 00:58:33.466635 tst assert_extension.py: using RAC 143 00:58:33.583627 tst assert_extension.py: using CellId 24878 00:58:33.698585 tst assert_extension.py: using BVCI 24879 00:58:33.805305 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 00:58:33.816004 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 00:58:33.826400 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 00:58:33.836939 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 00:58:33.847535 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 00:58:33.858157 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 00:58:33.973560 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:58:34.467948 run create_hlr_db(pid=5612): Launched 00:58:34.598725 bus /sierra_2: Setting Powered False 00:58:35.662002 run create_hlr_db(pid=5612): Terminated: ok {rc=0} 00:58:36.088278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5614): Launched 00:58:36.386473 run osmo-hlr_10.42.42.2(pid=5615): Launched 00:58:36.500492 run osmo-stp_10.42.42.5: Starting osmo-stp 00:58:37.013756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5617): Launched 00:58:37.310972 run osmo-stp_10.42.42.5(pid=5618): Launched 00:58:37.424546 run osmo-msc_10.42.42.6: Starting osmo-msc 00:58:37.961567 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5620): Launched 00:58:38.260336 run osmo-msc_10.42.42.6(pid=5621): Launched 00:58:38.427224 run osmo-stp_10.42.42.5(pid=5618): ERR: Terminated: ERROR {rc=1} [trial-2367↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5618)] 00:58:38.553854 run osmo-stp_10.42.42.5(pid=5618): stdout: | (launched: 2022-12-10_00:58:37.256101) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:58:38.680431 run osmo-stp_10.42.42.5(pid=5618): stderr: | 20221210005837425 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005837425 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005837425 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005837426 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005837426 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005837426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005837426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:58:38.804888 run osmo-stp_10.42.42.5(pid=5618): stdout: | (launched: 2022-12-10_00:58:37.256101) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:58:38.923151 run osmo-stp_10.42.42.5(pid=5618): stderr: | 20221210005837425 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005837425 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005837425 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005837426 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005837426 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005837426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005837426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:58:39.064849 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=5618): Process ended prematurely: osmo-stp_10.42.42.5(pid=5618) [trial-2367↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5618)] [trial-2367↪ussd:trx-b200↪assert_extension.py:17] 00:58:39.073209 tst assert_extension.py:17: Test FAILED (5.8 sec) 00:58:39.099727 run osmo-hlr_10.42.42.2(pid=5615): ERR: Terminated: ERROR {rc=237} [trial-2367↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5615)] 00:58:39.147699 run osmo-hlr_10.42.42.2(pid=5615): stdout: | (launched: 2022-12-10_00:58:36.331262) 00:58:39.197470 run osmo-hlr_10.42.42.2(pid=5615): stderr: | 20221210005836505 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005836505 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005836505 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005836505 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005836506 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005836506 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005836517 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005836526 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005836526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005836526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:58:39.266538 run osmo-msc_10.42.42.6(pid=5621): ERR: Terminated: ERROR {rc=2} [trial-2367↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5621)] 00:58:39.314486 run osmo-msc_10.42.42.6(pid=5621): stdout: | (launched: 2022-12-10_00:58:38.204468) 00:58:39.364106 run osmo-msc_10.42.42.6(pid=5621): stderr: | 20221210005838478 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210005838478 DLGLOBAL DEBUG validating counter group 0x7fb6e1f3ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210005838478 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210005838478 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210005838478 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210005838479 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210005838480 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210005838481 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210005838481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210005838481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:58:39.414320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5614): Terminating (SIGTERM) 00:58:39.454249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5617): Terminating (SIGTERM) 00:58:39.494222 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5620): Terminating (SIGTERM) 00:58:39.535133 --- ParallelTerminationStrategy: PID 5614 died... 00:58:39.554288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5614): Terminated: ok {rc=0} 00:58:39.598627 --- ParallelTerminationStrategy: PID 5617 died... 00:58:39.617160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5617): Terminated: ok {rc=0} 00:58:39.661562 --- ParallelTerminationStrategy: PID 5620 died... 00:58:39.680115 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5620): Terminated: ok {rc=0} 00:58:39.767583 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 00:58:40.980864 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:58:40.987721 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 00:58:41.021595 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 00:58:41.047934 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 00:58:41.098905 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 00:58:41.131445 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 00:58:41.157360 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 00:58:41.708670 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 00:58:41.758204 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:58:41.769273 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:58:41.837387 tst mo_mt_call.py: using LAC 24879 00:58:41.958605 tst mo_mt_call.py: using RAC 144 00:58:42.078467 tst mo_mt_call.py: using CellId 24879 00:58:42.198922 tst mo_mt_call.py: using BVCI 24880 00:58:42.309994 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:58:42.320932 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:58:42.331831 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:58:42.342955 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:58:42.354121 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:58:42.365165 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:58:42.485303 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:58:42.601097 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:58:43.070540 run create_hlr_db(pid=5626): Launched 00:58:43.186391 bus /sierra_2: Setting Powered False 00:58:44.246143 run create_hlr_db(pid=5626): Terminated: ok {rc=0} 00:58:44.688247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5628): Launched 00:58:45.013534 run osmo-hlr_10.42.42.2(pid=5629): Launched 00:58:45.138080 run osmo-stp_10.42.42.5: Starting osmo-stp 00:58:45.702331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5631): Launched 00:58:46.049134 run osmo-stp_10.42.42.5(pid=5632): Launched 00:58:46.290323 run osmo-msc_10.42.42.6: Starting osmo-msc 00:58:46.962291 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5634): Launched 00:58:47.321194 run osmo-msc_10.42.42.6(pid=5635): Launched 00:58:47.496596 run osmo-stp_10.42.42.5(pid=5632): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5632)] 00:58:47.628153 run osmo-stp_10.42.42.5(pid=5632): stdout: | (launched: 2022-12-10_00:58:45.988817) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:58:47.757689 run osmo-stp_10.42.42.5(pid=5632): stderr: | 20221210005846321 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005846321 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005846321 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005846321 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005846322 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005846322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005846322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:58:47.884463 run osmo-stp_10.42.42.5(pid=5632): stdout: | (launched: 2022-12-10_00:58:45.988817) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:58:48.005626 run osmo-stp_10.42.42.5(pid=5632): stderr: | 20221210005846321 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005846321 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005846321 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005846321 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005846322 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005846322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005846322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:58:48.150346 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5632): Process ended prematurely: osmo-stp_10.42.42.5(pid=5632) [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5632)] [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 00:58:48.159318 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 00:58:48.186123 run osmo-hlr_10.42.42.2(pid=5629): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5629)] 00:58:48.234489 run osmo-hlr_10.42.42.2(pid=5629): stdout: | (launched: 2022-12-10_00:58:44.954142) 00:58:48.284240 run osmo-hlr_10.42.42.2(pid=5629): stderr: | 20221210005845155 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005845155 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005845155 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005845155 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005845155 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005845155 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005845168 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005845176 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005845176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005845176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:58:48.353471 run osmo-msc_10.42.42.6(pid=5635): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5635)] 00:58:48.401546 run osmo-msc_10.42.42.6(pid=5635): stdout: | (launched: 2022-12-10_00:58:47.264328) 00:58:48.450940 run osmo-msc_10.42.42.6(pid=5635): stderr: | 20221210005847533 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210005847533 DLGLOBAL DEBUG validating counter group 0x7fd8160d3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210005847533 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210005847533 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210005847533 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210005847533 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210005847535 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210005847535 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210005847535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210005847536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:58:48.500772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5628): Terminating (SIGTERM) 00:58:48.540540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5631): Terminating (SIGTERM) 00:58:48.580283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5634): Terminating (SIGTERM) 00:58:48.620331 --- ParallelTerminationStrategy: PID 5628 died... 00:58:48.639363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5628): Terminated: ok {rc=0} 00:58:48.683858 --- ParallelTerminationStrategy: PID 5631 died... 00:58:48.702242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5631): Terminated: ok {rc=0} 00:58:48.746102 --- ParallelTerminationStrategy: PID 5634 died... 00:58:48.764582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5634): Terminated: ok {rc=0} 00:58:48.851780 bus /sierra_3: Setting Powered False 00:58:49.951682 bus /sierra_3: Setting Powered False 00:58:51.065252 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 00:58:52.214262 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:58:52.226689 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:58:52.298375 tst mo_mt_call_osmux.py: using LAC 24880 00:58:52.427479 tst mo_mt_call_osmux.py: using RAC 145 00:58:52.556364 tst mo_mt_call_osmux.py: using CellId 24880 00:58:52.685789 tst mo_mt_call_osmux.py: using BVCI 24881 00:58:52.803619 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:58:52.815505 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:58:52.826921 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:58:52.838567 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:58:52.850249 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:58:52.862153 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:58:52.977384 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:58:53.099029 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:58:53.601705 run create_hlr_db(pid=5637): Launched 00:58:53.734357 bus /sierra_2: Setting Powered False 00:58:54.798796 run create_hlr_db(pid=5637): Terminated: ok {rc=0} 00:58:55.232710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5639): Launched 00:58:55.535948 run osmo-hlr_10.42.42.2(pid=5640): Launched 00:58:55.652413 run osmo-stp_10.42.42.5: Starting osmo-stp 00:58:56.190645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5642): Launched 00:58:56.495122 run osmo-stp_10.42.42.5(pid=5643): Launched 00:58:56.611642 run osmo-msc_10.42.42.6: Starting osmo-msc 00:58:57.177052 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5645): Launched 00:58:57.479621 run osmo-msc_10.42.42.6(pid=5646): Launched 00:58:57.652075 run osmo-stp_10.42.42.5(pid=5643): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5643)] 00:58:57.781353 run osmo-stp_10.42.42.5(pid=5643): stdout: | (launched: 2022-12-10_00:58:56.438949) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:58:57.910004 run osmo-stp_10.42.42.5(pid=5643): stderr: | 20221210005856607 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005856607 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005856607 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005856608 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005856610 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005856610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005856610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:58:58.036161 run osmo-stp_10.42.42.5(pid=5643): stdout: | (launched: 2022-12-10_00:58:56.438949) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:58:58.156808 run osmo-stp_10.42.42.5(pid=5643): stderr: | 20221210005856607 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005856607 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005856607 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005856608 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005856610 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005856610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005856610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:58:58.301484 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5643): Process ended prematurely: osmo-stp_10.42.42.5(pid=5643) [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5643)] [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 00:58:58.310323 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 00:58:58.337239 run osmo-hlr_10.42.42.2(pid=5640): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5640)] 00:58:58.385468 run osmo-hlr_10.42.42.2(pid=5640): stdout: | (launched: 2022-12-10_00:58:55.480174) 00:58:58.434969 run osmo-hlr_10.42.42.2(pid=5640): stderr: | 20221210005855659 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005855659 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005855659 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005855659 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005855659 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005855659 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005855671 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005855681 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005855681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005855681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:58:58.503668 run osmo-msc_10.42.42.6(pid=5646): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5646)] 00:58:58.551472 run osmo-msc_10.42.42.6(pid=5646): stdout: | (launched: 2022-12-10_00:58:57.424118) 00:58:58.600765 run osmo-msc_10.42.42.6(pid=5646): stderr: | 20221210005857695 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210005857696 DLGLOBAL DEBUG validating counter group 0x7fa8180b3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210005857696 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210005857696 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210005857696 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210005857696 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210005857698 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210005857698 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210005857698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210005857699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:58:58.650550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5639): Terminating (SIGTERM) 00:58:58.690609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5642): Terminating (SIGTERM) 00:58:58.730638 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5645): Terminating (SIGTERM) 00:58:58.770906 --- ParallelTerminationStrategy: PID 5639 died... 00:58:58.789889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5639): Terminated: ok {rc=0} 00:58:58.834105 --- ParallelTerminationStrategy: PID 5642 died... 00:58:58.852597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5642): Terminated: ok {rc=0} 00:58:58.897128 --- ParallelTerminationStrategy: PID 5645 died... 00:58:58.915560 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5645): Terminated: ok {rc=0} 00:58:59.002506 bus /sierra_3: Setting Powered False 00:59:00.101905 bus /sierra_3: Setting Powered False 00:59:01.234516 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 00:59:02.502264 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:59:02.509389 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 00:59:02.543819 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 00:59:02.571542 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 00:59:02.624378 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 00:59:02.658541 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 00:59:02.685683 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 00:59:03.238255 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 00:59:03.291318 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:03.303045 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:59:03.373287 tst mo_mt_call.py: using LAC 24881 00:59:03.498523 tst mo_mt_call.py: using RAC 146 00:59:03.624575 tst mo_mt_call.py: using CellId 24881 00:59:03.754973 tst mo_mt_call.py: using BVCI 24882 00:59:03.874458 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:03.886185 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:03.897744 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:03.909446 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:03.921290 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:03.932729 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:59:04.046039 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:59:04.165598 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:59:04.668899 run create_hlr_db(pid=5651): Launched 00:59:04.800525 bus /sierra_2: Setting Powered False 00:59:05.864586 run create_hlr_db(pid=5651): Terminated: ok {rc=0} 00:59:06.315674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5653): Launched 00:59:06.639862 run osmo-hlr_10.42.42.2(pid=5654): Launched 00:59:06.763764 run osmo-stp_10.42.42.5: Starting osmo-stp 00:59:07.321126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5656): Launched 00:59:07.645287 run osmo-stp_10.42.42.5(pid=5657): Launched 00:59:07.769939 run osmo-msc_10.42.42.6: Starting osmo-msc 00:59:08.356398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5659): Launched 00:59:08.680088 run osmo-msc_10.42.42.6(pid=5660): Launched 00:59:08.861053 run osmo-stp_10.42.42.5(pid=5657): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5657)] 00:59:08.998258 run osmo-stp_10.42.42.5(pid=5657): stdout: | (launched: 2022-12-10_00:59:07.585689) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:59:09.135511 run osmo-stp_10.42.42.5(pid=5657): stderr: | 20221210005907780 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005907780 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005907780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005907781 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005907781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005907781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005907781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:59:09.270885 run osmo-stp_10.42.42.5(pid=5657): stdout: | (launched: 2022-12-10_00:59:07.585689) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:59:09.399633 run osmo-stp_10.42.42.5(pid=5657): stderr: | 20221210005907780 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005907780 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005907780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005907781 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005907781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005907781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005907781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:59:09.553830 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5657): Process ended prematurely: osmo-stp_10.42.42.5(pid=5657) [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5657)] [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 00:59:09.563544 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 00:59:09.591421 run osmo-hlr_10.42.42.2(pid=5654): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5654)] 00:59:09.641281 run osmo-hlr_10.42.42.2(pid=5654): stdout: | (launched: 2022-12-10_00:59:06.580745) 00:59:09.692618 run osmo-hlr_10.42.42.2(pid=5654): stderr: | 20221210005906781 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005906781 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005906781 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005906781 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005906782 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005906782 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005906828 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005906837 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005906838 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005906838 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:59:09.764457 run osmo-msc_10.42.42.6(pid=5660): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5660)] 00:59:09.814227 run osmo-msc_10.42.42.6(pid=5660): stdout: | (launched: 2022-12-10_00:59:08.620787) 00:59:09.865459 run osmo-msc_10.42.42.6(pid=5660): stderr: | 20221210005908943 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210005908943 DLGLOBAL DEBUG validating counter group 0x7f26738d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210005908943 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210005908943 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210005908943 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210005908944 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210005908945 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210005908946 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210005908946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210005908946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:59:09.917138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5653): Terminating (SIGTERM) 00:59:09.958614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5656): Terminating (SIGTERM) 00:59:10.000043 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5659): Terminating (SIGTERM) 00:59:10.042072 --- ParallelTerminationStrategy: PID 5653 died... 00:59:10.061968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5653): Terminated: ok {rc=0} 00:59:10.107775 --- ParallelTerminationStrategy: PID 5656 died... 00:59:10.127180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5656): Terminated: ok {rc=0} 00:59:10.173203 --- ParallelTerminationStrategy: PID 5659 died... 00:59:10.192740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5659): Terminated: ok {rc=0} 00:59:10.281109 bus /sierra_3: Setting Powered False 00:59:11.380814 bus /sierra_3: Setting Powered False 00:59:12.497302 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 00:59:13.647697 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:13.660180 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:59:13.732271 tst mo_mt_call_osmux.py: using LAC 24882 00:59:13.860731 tst mo_mt_call_osmux.py: using RAC 147 00:59:13.988550 tst mo_mt_call_osmux.py: using CellId 24882 00:59:14.115776 tst mo_mt_call_osmux.py: using BVCI 24883 00:59:14.233130 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:14.244693 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:14.256108 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:14.267414 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:14.278825 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:14.290151 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:59:14.410924 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:59:14.526156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:59:14.996543 run create_hlr_db(pid=5662): Launched 00:59:15.114386 bus /sierra_2: Setting Powered False 00:59:16.172671 run create_hlr_db(pid=5662): Terminated: ok {rc=0} 00:59:16.610844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5664): Launched 00:59:16.945147 run osmo-hlr_10.42.42.2(pid=5665): Launched 00:59:17.186566 run osmo-stp_10.42.42.5: Starting osmo-stp 00:59:17.768203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5667): Launched 00:59:18.092433 run osmo-stp_10.42.42.5(pid=5668): Launched 00:59:18.216233 run osmo-msc_10.42.42.6: Starting osmo-msc 00:59:18.807059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5670): Launched 00:59:19.132531 run osmo-msc_10.42.42.6(pid=5671): Launched 00:59:19.313124 run osmo-stp_10.42.42.5(pid=5668): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5668)] 00:59:19.449224 run osmo-stp_10.42.42.5(pid=5668): stdout: | (launched: 2022-12-10_00:59:18.033168) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:59:19.585272 run osmo-stp_10.42.42.5(pid=5668): stderr: | 20221210005918226 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005918226 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005918226 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005918227 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005918227 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005918227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005918227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:59:19.720693 run osmo-stp_10.42.42.5(pid=5668): stdout: | (launched: 2022-12-10_00:59:18.033168) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:59:19.849607 run osmo-stp_10.42.42.5(pid=5668): stderr: | 20221210005918226 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005918226 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005918226 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005918227 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005918227 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005918227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005918227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:59:20.004220 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5668): Process ended prematurely: osmo-stp_10.42.42.5(pid=5668) [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5668)] [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 00:59:20.014245 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 00:59:20.042541 run osmo-hlr_10.42.42.2(pid=5665): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5665)] 00:59:20.093348 run osmo-hlr_10.42.42.2(pid=5665): stdout: | (launched: 2022-12-10_00:59:16.874568) 00:59:20.145645 run osmo-hlr_10.42.42.2(pid=5665): stderr: | 20221210005917078 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005917078 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005917078 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005917078 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005917079 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005917079 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005917095 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005917103 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005917103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005917103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:59:20.218207 run osmo-msc_10.42.42.6(pid=5671): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5671)] 00:59:20.268331 run osmo-msc_10.42.42.6(pid=5671): stdout: | (launched: 2022-12-10_00:59:19.073488) 00:59:20.319856 run osmo-msc_10.42.42.6(pid=5671): stderr: | 20221210005919396 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210005919396 DLGLOBAL DEBUG validating counter group 0x7f4910611c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210005919396 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210005919396 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210005919397 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210005919397 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210005919398 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210005919399 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210005919399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210005919399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:59:20.371782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5664): Terminating (SIGTERM) 00:59:20.413471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5667): Terminating (SIGTERM) 00:59:20.455567 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5670): Terminating (SIGTERM) 00:59:20.498070 --- ParallelTerminationStrategy: PID 5664 died... 00:59:20.518113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5664): Terminated: ok {rc=0} 00:59:20.564504 --- ParallelTerminationStrategy: PID 5667 died... 00:59:20.584038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5667): Terminated: ok {rc=0} 00:59:20.630368 --- ParallelTerminationStrategy: PID 5670 died... 00:59:20.649929 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5670): Terminated: ok {rc=0} 00:59:20.738308 bus /sierra_3: Setting Powered False 00:59:21.837833 bus /sierra_3: Setting Powered False 00:59:22.955686 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 00:59:24.204319 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:59:24.210802 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 00:59:24.244121 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 00:59:24.270640 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 00:59:24.323037 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 00:59:24.356239 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 00:59:24.382265 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 00:59:24.930943 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 00:59:24.979667 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:59:24.990991 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:59:25.064318 tst mo_mt_call.py: using LAC 24883 00:59:25.182702 tst mo_mt_call.py: using RAC 148 00:59:25.302784 tst mo_mt_call.py: using CellId 24883 00:59:25.419934 tst mo_mt_call.py: using BVCI 24884 00:59:25.529427 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:59:25.540412 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:59:25.551306 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:59:25.562463 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:59:25.573555 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:59:25.584836 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:59:25.702864 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:59:25.822698 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:59:26.325708 run create_hlr_db(pid=5676): Launched 00:59:26.458757 bus /sierra_2: Setting Powered False 00:59:27.522653 run create_hlr_db(pid=5676): Terminated: ok {rc=0} 00:59:27.971608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5678): Launched 00:59:28.296233 run osmo-hlr_10.42.42.2(pid=5679): Launched 00:59:28.419255 run osmo-stp_10.42.42.5: Starting osmo-stp 00:59:28.979243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5681): Launched 00:59:29.304317 run osmo-stp_10.42.42.5(pid=5682): Launched 00:59:29.429110 run osmo-msc_10.42.42.6: Starting osmo-msc 00:59:30.014982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5684): Launched 00:59:30.340709 run osmo-msc_10.42.42.6(pid=5685): Launched 00:59:30.522515 run osmo-stp_10.42.42.5(pid=5682): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5682)] 00:59:30.659369 run osmo-stp_10.42.42.5(pid=5682): stdout: | (launched: 2022-12-10_00:59:29.245298) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:59:30.797989 run osmo-stp_10.42.42.5(pid=5682): stderr: | 20221210005929439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005929439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005929439 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005929440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005929440 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005929440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005929440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:59:30.946213 run osmo-stp_10.42.42.5(pid=5682): stdout: | (launched: 2022-12-10_00:59:29.245298) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:59:31.079364 run osmo-stp_10.42.42.5(pid=5682): stderr: | 20221210005929439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005929439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005929439 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005929440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005929440 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005929440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005929440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:59:31.238856 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5682): Process ended prematurely: osmo-stp_10.42.42.5(pid=5682) [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5682)] [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 00:59:31.249441 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 00:59:31.279026 run osmo-hlr_10.42.42.2(pid=5679): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5679)] 00:59:31.331135 run osmo-hlr_10.42.42.2(pid=5679): stdout: | (launched: 2022-12-10_00:59:28.237016) 00:59:31.384618 run osmo-hlr_10.42.42.2(pid=5679): stderr: | 20221210005928438 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005928438 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005928438 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005928438 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005928438 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005928439 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005928451 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005928460 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005928460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005928460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:59:31.458085 run osmo-msc_10.42.42.6(pid=5685): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5685)] 00:59:31.509378 run osmo-msc_10.42.42.6(pid=5685): stdout: | (launched: 2022-12-10_00:59:30.281179) 00:59:31.561938 run osmo-msc_10.42.42.6(pid=5685): stderr: | 20221210005930606 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210005930606 DLGLOBAL DEBUG validating counter group 0x7fe1d816ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210005930606 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210005930606 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210005930607 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210005930607 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210005930608 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210005930609 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210005930609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210005930609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:59:31.615334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5678): Terminating (SIGTERM) 00:59:31.658066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5681): Terminating (SIGTERM) 00:59:31.702445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5684): Terminating (SIGTERM) 00:59:31.744865 --- ParallelTerminationStrategy: PID 5678 died... 00:59:31.764900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5678): Terminated: ok {rc=0} 00:59:31.811789 --- ParallelTerminationStrategy: PID 5681 died... 00:59:31.831772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5681): Terminated: ok {rc=0} 00:59:31.878976 --- ParallelTerminationStrategy: PID 5684 died... 00:59:31.898990 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5684): Terminated: ok {rc=0} 00:59:31.988623 bus /sierra_3: Setting Powered False 00:59:33.085669 bus /sierra_3: Setting Powered False 00:59:34.201260 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 00:59:35.352868 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:59:35.365374 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:59:35.437389 tst mo_mt_call_osmux.py: using LAC 24884 00:59:35.565817 tst mo_mt_call_osmux.py: using RAC 149 00:59:35.694106 tst mo_mt_call_osmux.py: using CellId 24884 00:59:35.813577 tst mo_mt_call_osmux.py: using BVCI 24885 00:59:35.932108 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:59:35.943840 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:59:35.955339 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:59:35.966895 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:59:35.978556 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:59:35.990036 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:59:36.105564 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:59:36.224395 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:59:36.725877 run create_hlr_db(pid=5687): Launched 00:59:36.857184 bus /sierra_2: Setting Powered False 00:59:37.921493 run create_hlr_db(pid=5687): Terminated: ok {rc=0} 00:59:38.370976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5689): Launched 00:59:38.694992 run osmo-hlr_10.42.42.2(pid=5690): Launched 00:59:38.819162 run osmo-stp_10.42.42.5: Starting osmo-stp 00:59:39.376293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5693): Launched 00:59:39.700230 run osmo-stp_10.42.42.5(pid=5694): Launched 00:59:39.824215 run osmo-msc_10.42.42.6: Starting osmo-msc 00:59:40.412069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5696): Launched 00:59:40.736592 run osmo-msc_10.42.42.6(pid=5697): Launched 00:59:40.918372 run osmo-stp_10.42.42.5(pid=5694): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5694)] 00:59:41.058177 run osmo-stp_10.42.42.5(pid=5694): stdout: | (launched: 2022-12-10_00:59:39.641113) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:59:41.195281 run osmo-stp_10.42.42.5(pid=5694): stderr: | 20221210005939833 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005939833 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005939833 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005939833 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005939836 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005939836 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005939836 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:59:41.331726 run osmo-stp_10.42.42.5(pid=5694): stdout: | (launched: 2022-12-10_00:59:39.641113) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:59:41.460799 run osmo-stp_10.42.42.5(pid=5694): stderr: | 20221210005939833 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005939833 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005939833 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005939833 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005939836 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005939836 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005939836 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:59:41.615702 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5694): Process ended prematurely: osmo-stp_10.42.42.5(pid=5694) [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5694)] [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 00:59:41.625263 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 00:59:41.653117 run osmo-hlr_10.42.42.2(pid=5690): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5690)] 00:59:41.703538 run osmo-hlr_10.42.42.2(pid=5690): stdout: | (launched: 2022-12-10_00:59:38.635786) 00:59:41.755783 run osmo-hlr_10.42.42.2(pid=5690): stderr: | 20221210005938835 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005938835 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005938835 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005938835 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005938836 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005938836 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005938847 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005938856 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005938856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005938856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:59:41.828341 run osmo-msc_10.42.42.6(pid=5697): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5697)] 00:59:41.878642 run osmo-msc_10.42.42.6(pid=5697): stdout: | (launched: 2022-12-10_00:59:40.677407) 00:59:41.930597 run osmo-msc_10.42.42.6(pid=5697): stderr: | 20221210005940999 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210005940999 DLGLOBAL DEBUG validating counter group 0x7f409c9e9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210005940999 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210005940999 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210005941000 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210005941000 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210005941001 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210005941002 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210005941002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210005941002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:59:41.982939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5689): Terminating (SIGTERM) 00:59:42.025065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5693): Terminating (SIGTERM) 00:59:42.066710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5696): Terminating (SIGTERM) 00:59:42.108546 --- ParallelTerminationStrategy: PID 5689 died... 00:59:42.128195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5689): Terminated: ok {rc=0} 00:59:42.174034 --- ParallelTerminationStrategy: PID 5693 died... 00:59:42.193440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5693): Terminated: ok {rc=0} 00:59:42.239377 --- ParallelTerminationStrategy: PID 5696 died... 00:59:42.258788 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5696): Terminated: ok {rc=0} 00:59:42.346475 bus /sierra_3: Setting Powered False 00:59:43.442637 bus /sierra_3: Setting Powered False 00:59:44.558011 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 00:59:45.805419 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:59:45.811865 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 00:59:45.851797 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 00:59:45.881570 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 00:59:45.937475 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 00:59:45.972838 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 00:59:46.001777 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 00:59:46.576582 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 00:59:46.632795 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:59:46.644837 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 00:59:46.715617 tst mo_mt_call.py: using LAC 24885 00:59:46.836187 tst mo_mt_call.py: using RAC 150 00:59:46.998141 tst mo_mt_call.py: using CellId 24885 00:59:47.142502 tst mo_mt_call.py: using BVCI 24886 00:59:47.295586 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:59:47.309309 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:59:47.324184 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:59:47.337158 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:59:47.349322 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:59:47.361919 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:59:47.485862 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:59:47.605550 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:59:48.108147 run create_hlr_db(pid=5702): Launched 00:59:48.240273 bus /sierra_2: Setting Powered False 00:59:49.305660 run create_hlr_db(pid=5702): Terminated: ok {rc=0} 00:59:49.738611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5704): Launched 00:59:50.041263 run osmo-hlr_10.42.42.2(pid=5705): Launched 00:59:50.157314 run osmo-stp_10.42.42.5: Starting osmo-stp 00:59:50.693692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5707): Launched 00:59:50.997429 run osmo-stp_10.42.42.5(pid=5708): Launched 00:59:51.113579 run osmo-msc_10.42.42.6: Starting osmo-msc 00:59:51.668886 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5710): Launched 00:59:51.973495 run osmo-msc_10.42.42.6(pid=5711): Launched 00:59:52.146001 run osmo-stp_10.42.42.5(pid=5708): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5708)] 00:59:52.275939 run osmo-stp_10.42.42.5(pid=5708): stdout: | (launched: 2022-12-10_00:59:50.941430) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:59:52.405146 run osmo-stp_10.42.42.5(pid=5708): stderr: | 20221210005951116 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005951116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005951116 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005951117 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005951117 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005951117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005951117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:59:52.532157 run osmo-stp_10.42.42.5(pid=5708): stdout: | (launched: 2022-12-10_00:59:50.941430) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:59:52.654260 run osmo-stp_10.42.42.5(pid=5708): stderr: | 20221210005951116 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210005951116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210005951116 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210005951117 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210005951117 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210005951117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210005951117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:59:52.800028 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5708): Process ended prematurely: osmo-stp_10.42.42.5(pid=5708) [trial-2367↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5708)] [trial-2367↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 00:59:52.809295 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 00:59:52.836477 run osmo-hlr_10.42.42.2(pid=5705): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5705)] 00:59:52.884446 run osmo-hlr_10.42.42.2(pid=5705): stdout: | (launched: 2022-12-10_00:59:49.985586) 00:59:52.933890 run osmo-hlr_10.42.42.2(pid=5705): stderr: | 20221210005950164 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210005950164 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210005950164 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210005950164 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210005950164 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210005950164 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210005950176 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210005950185 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210005950185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210005950185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:59:53.002523 run osmo-msc_10.42.42.6(pid=5711): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5711)] 00:59:53.050178 run osmo-msc_10.42.42.6(pid=5711): stdout: | (launched: 2022-12-10_00:59:51.917398) 00:59:53.099413 run osmo-msc_10.42.42.6(pid=5711): stderr: | 20221210005952191 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210005952191 DLGLOBAL DEBUG validating counter group 0x7f204ff7fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210005952191 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210005952191 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210005952191 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210005952191 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210005952193 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210005952194 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210005952194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210005952194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:59:53.149279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5704): Terminating (SIGTERM) 00:59:53.188979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5707): Terminating (SIGTERM) 00:59:53.228725 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5710): Terminating (SIGTERM) 00:59:53.268714 --- ParallelTerminationStrategy: PID 5704 died... 00:59:53.287696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5704): Terminated: ok {rc=0} 00:59:53.332271 --- ParallelTerminationStrategy: PID 5707 died... 00:59:53.350858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5707): Terminated: ok {rc=0} 00:59:53.395192 --- ParallelTerminationStrategy: PID 5710 died... 00:59:53.413698 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5710): Terminated: ok {rc=0} 00:59:53.500090 bus /sierra_3: Setting Powered False 00:59:54.598657 bus /sierra_3: Setting Powered False 00:59:55.712860 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 00:59:56.862348 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:59:56.874568 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 00:59:56.948853 tst mo_mt_call_osmux.py: using LAC 24886 00:59:57.075549 tst mo_mt_call_osmux.py: using RAC 151 00:59:57.200774 tst mo_mt_call_osmux.py: using CellId 24886 00:59:57.325270 tst mo_mt_call_osmux.py: using BVCI 24887 00:59:57.443201 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:59:57.454780 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:59:57.466130 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:59:57.477463 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:59:57.488824 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:59:57.500265 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:59:57.619985 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:59:57.736787 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:59:58.208138 run create_hlr_db(pid=5713): Launched 00:59:58.325103 bus /sierra_2: Setting Powered False 00:59:59.386143 run create_hlr_db(pid=5713): Terminated: ok {rc=0} 00:59:59.829413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5715): Launched 01:00:00.156377 run osmo-hlr_10.42.42.2(pid=5716): Launched 01:00:00.280385 run osmo-stp_10.42.42.5: Starting osmo-stp 01:00:00.851461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5718): Launched 01:00:01.217363 run osmo-stp_10.42.42.5(pid=5719): Launched 01:00:01.546277 run osmo-msc_10.42.42.6: Starting osmo-msc 01:00:02.160227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5724): Launched 01:00:02.496715 run osmo-msc_10.42.42.6(pid=5725): Launched 01:00:02.677738 run osmo-stp_10.42.42.5(pid=5719): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5719)] 01:00:02.814487 run osmo-stp_10.42.42.5(pid=5719): stdout: | (launched: 2022-12-10_01:00:01.156255) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:02.951041 run osmo-stp_10.42.42.5(pid=5719): stderr: | 20221210010001386 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010001386 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010001387 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010001388 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010001390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010001390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010001390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:03.087601 run osmo-stp_10.42.42.5(pid=5719): stdout: | (launched: 2022-12-10_01:00:01.156255) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:03.216619 run osmo-stp_10.42.42.5(pid=5719): stderr: | 20221210010001386 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010001386 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010001387 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010001388 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010001390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010001390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010001390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:03.371518 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5719): Process ended prematurely: osmo-stp_10.42.42.5(pid=5719) [trial-2367↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5719)] [trial-2367↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 01:00:03.381277 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 01:00:03.409585 run osmo-hlr_10.42.42.2(pid=5716): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5716)] 01:00:03.459900 run osmo-hlr_10.42.42.2(pid=5716): stdout: | (launched: 2022-12-10_01:00:00.097165) 01:00:03.512019 run osmo-hlr_10.42.42.2(pid=5716): stderr: | 20221210010000296 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010000296 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010000296 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010000296 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010000296 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010000296 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010000309 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010000317 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010000317 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010000317 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:00:03.584522 run osmo-msc_10.42.42.6(pid=5725): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5725)] 01:00:03.634792 run osmo-msc_10.42.42.6(pid=5725): stdout: | (launched: 2022-12-10_01:00:02.437487) 01:00:03.686904 run osmo-msc_10.42.42.6(pid=5725): stderr: | 20221210010002763 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210010002763 DLGLOBAL DEBUG validating counter group 0x7f519fb9cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210010002763 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210010002763 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210010002763 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210010002763 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210010002765 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210010002766 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210010002766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210010002766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:00:03.739551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5715): Terminating (SIGTERM) 01:00:03.781716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5718): Terminating (SIGTERM) 01:00:03.823674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5724): Terminating (SIGTERM) 01:00:03.865834 --- ParallelTerminationStrategy: PID 5715 died... 01:00:03.885815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5715): Terminated: ok {rc=0} 01:00:03.932892 --- ParallelTerminationStrategy: PID 5718 died... 01:00:03.952420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5718): Terminated: ok {rc=0} 01:00:03.998382 --- ParallelTerminationStrategy: PID 5724 died... 01:00:04.017856 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5724): Terminated: ok {rc=0} 01:00:04.106236 bus /sierra_3: Setting Powered False 01:00:05.204694 bus /sierra_3: Setting Powered False 01:00:06.320504 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 01:00:07.575050 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:00:07.581982 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 01:00:07.615885 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 01:00:07.643033 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 01:00:07.696188 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 01:00:07.730175 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 01:00:07.757446 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 01:00:08.309436 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 01:00:08.361342 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:08.372738 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:00:08.443272 tst mo_mt_call.py: using LAC 24887 01:00:08.575105 tst mo_mt_call.py: using RAC 152 01:00:08.694459 tst mo_mt_call.py: using CellId 24887 01:00:08.811251 tst mo_mt_call.py: using BVCI 24888 01:00:08.920717 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:08.931945 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:08.943043 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:08.954388 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:08.965803 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:08.977185 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:00:09.096317 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:00:09.218709 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:00:09.723246 run create_hlr_db(pid=5732): Launched 01:00:09.855333 bus /sierra_2: Setting Powered False 01:00:10.919682 run create_hlr_db(pid=5732): Terminated: ok {rc=0} 01:00:11.353129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5734): Launched 01:00:11.657181 run osmo-hlr_10.42.42.2(pid=5735): Launched 01:00:11.773444 run osmo-stp_10.42.42.5: Starting osmo-stp 01:00:12.304788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5737): Launched 01:00:12.606971 run osmo-stp_10.42.42.5(pid=5738): Launched 01:00:12.722669 run osmo-msc_10.42.42.6: Starting osmo-msc 01:00:13.269356 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5740): Launched 01:00:13.572933 run osmo-msc_10.42.42.6(pid=5741): Launched 01:00:13.743259 run osmo-stp_10.42.42.5(pid=5738): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5738)] 01:00:13.871640 run osmo-stp_10.42.42.5(pid=5738): stdout: | (launched: 2022-12-10_01:00:12.551595) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:13.999732 run osmo-stp_10.42.42.5(pid=5738): stderr: | 20221210010012721 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010012721 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010012721 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010012722 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010012722 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010012722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010012722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:14.126127 run osmo-stp_10.42.42.5(pid=5738): stdout: | (launched: 2022-12-10_01:00:12.551595) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:14.247059 run osmo-stp_10.42.42.5(pid=5738): stderr: | 20221210010012721 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010012721 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010012721 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010012722 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010012722 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010012722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010012722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:14.391411 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5738): Process ended prematurely: osmo-stp_10.42.42.5(pid=5738) [trial-2367↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5738)] [trial-2367↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 01:00:14.400807 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:00:14.427988 run osmo-hlr_10.42.42.2(pid=5735): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5735)] 01:00:14.475930 run osmo-hlr_10.42.42.2(pid=5735): stdout: | (launched: 2022-12-10_01:00:11.601670) 01:00:14.525585 run osmo-hlr_10.42.42.2(pid=5735): stderr: | 20221210010011780 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010011780 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010011780 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010011780 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010011780 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010011780 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010011792 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010011801 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010011802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010011802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:00:14.594740 run osmo-msc_10.42.42.6(pid=5741): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5741)] 01:00:14.642780 run osmo-msc_10.42.42.6(pid=5741): stdout: | (launched: 2022-12-10_01:00:13.516620) 01:00:14.692526 run osmo-msc_10.42.42.6(pid=5741): stderr: | 20221210010013790 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210010013790 DLGLOBAL DEBUG validating counter group 0x7f808d2f4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210010013790 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210010013790 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210010013790 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210010013791 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210010013792 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210010013793 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210010013793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210010013793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:00:14.742450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5734): Terminating (SIGTERM) 01:00:14.782470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5737): Terminating (SIGTERM) 01:00:14.822522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5740): Terminating (SIGTERM) 01:00:14.862800 --- ParallelTerminationStrategy: PID 5734 died... 01:00:14.881955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5734): Terminated: ok {rc=0} 01:00:14.926644 --- ParallelTerminationStrategy: PID 5737 died... 01:00:14.945280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5737): Terminated: ok {rc=0} 01:00:14.989924 --- ParallelTerminationStrategy: PID 5740 died... 01:00:15.008509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5740): Terminated: ok {rc=0} 01:00:15.092730 bus /sierra_3: Setting Powered False 01:00:16.190585 bus /sierra_3: Setting Powered False 01:00:17.306971 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 01:00:18.455545 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:18.467521 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:00:18.537178 tst mo_mt_call_osmux.py: using LAC 24888 01:00:18.657368 tst mo_mt_call_osmux.py: using RAC 153 01:00:18.778520 tst mo_mt_call_osmux.py: using CellId 24888 01:00:18.909547 tst mo_mt_call_osmux.py: using BVCI 24889 01:00:19.028669 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:19.040407 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:19.052284 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:19.063918 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:19.076480 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:19.088249 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:00:19.204653 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:00:19.321457 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:00:19.793748 run create_hlr_db(pid=5743): Launched 01:00:19.911212 bus /sierra_2: Setting Powered False 01:00:20.972557 run create_hlr_db(pid=5743): Terminated: ok {rc=0} 01:00:21.417497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5745): Launched 01:00:21.746321 run osmo-hlr_10.42.42.2(pid=5746): Launched 01:00:21.871293 run osmo-stp_10.42.42.5: Starting osmo-stp 01:00:22.437706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5748): Launched 01:00:22.763834 run osmo-stp_10.42.42.5(pid=5749): Launched 01:00:22.888219 run osmo-msc_10.42.42.6: Starting osmo-msc 01:00:23.477096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5751): Launched 01:00:23.802487 run osmo-msc_10.42.42.6(pid=5752): Launched 01:00:23.983386 run osmo-stp_10.42.42.5(pid=5749): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5749)] 01:00:24.120477 run osmo-stp_10.42.42.5(pid=5749): stdout: | (launched: 2022-12-10_01:00:22.704223) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:24.256806 run osmo-stp_10.42.42.5(pid=5749): stderr: | 20221210010022897 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010022897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010022897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010022898 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010022898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010022898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010022898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:24.393408 run osmo-stp_10.42.42.5(pid=5749): stdout: | (launched: 2022-12-10_01:00:22.704223) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:24.522940 run osmo-stp_10.42.42.5(pid=5749): stderr: | 20221210010022897 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010022897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010022897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010022898 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010022898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010022898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010022898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:24.677810 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5749): Process ended prematurely: osmo-stp_10.42.42.5(pid=5749) [trial-2367↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5749)] [trial-2367↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 01:00:24.687342 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 01:00:24.715181 run osmo-hlr_10.42.42.2(pid=5746): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5746)] 01:00:24.765440 run osmo-hlr_10.42.42.2(pid=5746): stdout: | (launched: 2022-12-10_01:00:21.686487) 01:00:24.817694 run osmo-hlr_10.42.42.2(pid=5746): stderr: | 20221210010021887 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010021887 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010021887 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010021887 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010021887 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010021887 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010021900 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010021910 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010021910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010021910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:00:24.890342 run osmo-msc_10.42.42.6(pid=5752): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5752)] 01:00:24.940382 run osmo-msc_10.42.42.6(pid=5752): stdout: | (launched: 2022-12-10_01:00:23.743084) 01:00:24.992287 run osmo-msc_10.42.42.6(pid=5752): stderr: | 20221210010024065 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210010024065 DLGLOBAL DEBUG validating counter group 0x7fc842582c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210010024065 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210010024065 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210010024065 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210010024066 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210010024067 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210010024068 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210010024068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210010024068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:00:25.044250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5745): Terminating (SIGTERM) 01:00:25.086622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5748): Terminating (SIGTERM) 01:00:25.128622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5751): Terminating (SIGTERM) 01:00:25.170606 --- ParallelTerminationStrategy: PID 5745 died... 01:00:25.190615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5745): Terminated: ok {rc=0} 01:00:25.236718 --- ParallelTerminationStrategy: PID 5748 died... 01:00:25.256134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5748): Terminated: ok {rc=0} 01:00:25.301863 --- ParallelTerminationStrategy: PID 5751 died... 01:00:25.321357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5751): Terminated: ok {rc=0} 01:00:25.408694 bus /sierra_3: Setting Powered False 01:00:26.508065 bus /sierra_3: Setting Powered False 01:00:27.622619 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:00:28.875977 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:00:28.883776 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:00:28.917412 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 01:00:28.943586 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:00:28.994860 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:00:29.027854 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 01:00:29.054502 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:00:29.609690 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 01:00:29.658680 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:00:29.669853 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:00:29.738801 tst mo_mt_call.py: using LAC 24889 01:00:29.859206 tst mo_mt_call.py: using RAC 154 01:00:29.979381 tst mo_mt_call.py: using CellId 24889 01:00:30.100030 tst mo_mt_call.py: using BVCI 24890 01:00:30.211190 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:00:30.222367 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:00:30.233541 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:00:30.244673 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:00:30.255990 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:00:30.267110 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:00:30.385130 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:00:30.501578 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:00:30.998638 run create_hlr_db(pid=5757): Launched 01:00:31.150855 bus /sierra_2: Setting Powered False 01:00:32.212737 run create_hlr_db(pid=5757): Terminated: ok {rc=0} 01:00:32.665977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5759): Launched 01:00:32.991764 run osmo-hlr_10.42.42.2(pid=5760): Launched 01:00:33.116421 run osmo-stp_10.42.42.5: Starting osmo-stp 01:00:33.674341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5762): Launched 01:00:34.000018 run osmo-stp_10.42.42.5(pid=5763): Launched 01:00:34.124805 run osmo-msc_10.42.42.6: Starting osmo-msc 01:00:34.712003 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5765): Launched 01:00:35.036746 run osmo-msc_10.42.42.6(pid=5766): Launched 01:00:35.218533 run osmo-stp_10.42.42.5(pid=5763): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5763)] 01:00:35.355069 run osmo-stp_10.42.42.5(pid=5763): stdout: | (launched: 2022-12-10_01:00:33.940428) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:35.491783 run osmo-stp_10.42.42.5(pid=5763): stderr: | 20221210010034133 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010034133 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010034133 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010034134 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010034134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010034134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010034134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:35.628081 run osmo-stp_10.42.42.5(pid=5763): stdout: | (launched: 2022-12-10_01:00:33.940428) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:35.757226 run osmo-stp_10.42.42.5(pid=5763): stderr: | 20221210010034133 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010034133 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010034133 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010034134 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010034134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010034134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010034134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:35.911543 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5763): Process ended prematurely: osmo-stp_10.42.42.5(pid=5763) [trial-2367↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5763)] [trial-2367↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 01:00:35.920810 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 01:00:35.948746 run osmo-hlr_10.42.42.2(pid=5760): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5760)] 01:00:35.999170 run osmo-hlr_10.42.42.2(pid=5760): stdout: | (launched: 2022-12-10_01:00:32.932305) 01:00:36.050998 run osmo-hlr_10.42.42.2(pid=5760): stderr: | 20221210010033132 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010033132 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010033132 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010033133 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010033133 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010033133 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010033145 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010033153 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010033153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010033153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:00:36.123729 run osmo-msc_10.42.42.6(pid=5766): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5766)] 01:00:36.173910 run osmo-msc_10.42.42.6(pid=5766): stdout: | (launched: 2022-12-10_01:00:34.977469) 01:00:36.225812 run osmo-msc_10.42.42.6(pid=5766): stderr: | 20221210010035300 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210010035300 DLGLOBAL DEBUG validating counter group 0x7f1111c88c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210010035300 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210010035300 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210010035300 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210010035301 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210010035304 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210010035304 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210010035305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210010035305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:00:36.277991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5759): Terminating (SIGTERM) 01:00:36.319662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5762): Terminating (SIGTERM) 01:00:36.361583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5765): Terminating (SIGTERM) 01:00:36.403692 --- ParallelTerminationStrategy: PID 5759 died... 01:00:36.423757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5759): Terminated: ok {rc=0} 01:00:36.469909 --- ParallelTerminationStrategy: PID 5762 died... 01:00:36.489504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5762): Terminated: ok {rc=0} 01:00:36.535825 --- ParallelTerminationStrategy: PID 5765 died... 01:00:36.555682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5765): Terminated: ok {rc=0} 01:00:36.644377 bus /sierra_3: Setting Powered False 01:00:37.742593 bus /sierra_3: Setting Powered False 01:00:38.857005 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 01:00:40.008139 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:00:40.020651 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:00:40.092653 tst mo_mt_call_osmux.py: using LAC 24890 01:00:40.220092 tst mo_mt_call_osmux.py: using RAC 155 01:00:40.347226 tst mo_mt_call_osmux.py: using CellId 24890 01:00:40.479272 tst mo_mt_call_osmux.py: using BVCI 24891 01:00:40.597975 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:00:40.609673 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:00:40.621067 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:00:40.632343 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:00:40.643835 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:00:40.655228 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:00:40.774876 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:00:40.889969 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:00:41.362165 run create_hlr_db(pid=5768): Launched 01:00:41.479172 bus /sierra_2: Setting Powered False 01:00:42.540327 run create_hlr_db(pid=5768): Terminated: ok {rc=0} 01:00:42.984240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5770): Launched 01:00:43.310854 run osmo-hlr_10.42.42.2(pid=5771): Launched 01:00:43.435336 run osmo-stp_10.42.42.5: Starting osmo-stp 01:00:43.994283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5773): Launched 01:00:44.320097 run osmo-stp_10.42.42.5(pid=5774): Launched 01:00:44.443656 run osmo-msc_10.42.42.6: Starting osmo-msc 01:00:45.031430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5776): Launched 01:00:45.356305 run osmo-msc_10.42.42.6(pid=5777): Launched 01:00:45.538114 run osmo-stp_10.42.42.5(pid=5774): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5774)] 01:00:45.675290 run osmo-stp_10.42.42.5(pid=5774): stdout: | (launched: 2022-12-10_01:00:44.260855) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:45.812748 run osmo-stp_10.42.42.5(pid=5774): stderr: | 20221210010044454 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010044454 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010044455 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010044455 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010044455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010044456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010044456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:45.957794 run osmo-stp_10.42.42.5(pid=5774): stdout: | (launched: 2022-12-10_01:00:44.260855) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:46.088752 run osmo-stp_10.42.42.5(pid=5774): stderr: | 20221210010044454 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010044454 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010044455 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010044455 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010044455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010044456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010044456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:46.246232 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5774): Process ended prematurely: osmo-stp_10.42.42.5(pid=5774) [trial-2367↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5774)] [trial-2367↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 01:00:46.256194 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 01:00:46.285451 run osmo-hlr_10.42.42.2(pid=5771): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5771)] 01:00:46.336640 run osmo-hlr_10.42.42.2(pid=5771): stdout: | (launched: 2022-12-10_01:00:43.251624) 01:00:46.389974 run osmo-hlr_10.42.42.2(pid=5771): stderr: | 20221210010043449 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010043449 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010043449 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010043450 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010043450 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010043450 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010043461 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010043470 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010043471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010043471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:00:46.463548 run osmo-msc_10.42.42.6(pid=5777): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5777)] 01:00:46.514405 run osmo-msc_10.42.42.6(pid=5777): stdout: | (launched: 2022-12-10_01:00:45.296675) 01:00:46.567888 run osmo-msc_10.42.42.6(pid=5777): stderr: | 20221210010045618 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210010045618 DLGLOBAL DEBUG validating counter group 0x7f8357803c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210010045618 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210010045618 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210010045619 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210010045619 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210010045620 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210010045621 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210010045621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210010045621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:00:46.621167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5770): Terminating (SIGTERM) 01:00:46.664077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5773): Terminating (SIGTERM) 01:00:46.708304 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5776): Terminating (SIGTERM) 01:00:46.751120 --- ParallelTerminationStrategy: PID 5770 died... 01:00:46.771096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5770): Terminated: ok {rc=0} 01:00:46.818049 --- ParallelTerminationStrategy: PID 5773 died... 01:00:46.837828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5773): Terminated: ok {rc=0} 01:00:46.884319 --- ParallelTerminationStrategy: PID 5776 died... 01:00:46.904098 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5776): Terminated: ok {rc=0} 01:00:46.993103 bus /sierra_3: Setting Powered False 01:00:48.095452 bus /sierra_3: Setting Powered False 01:00:49.209528 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 01:00:50.456545 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:00:50.462115 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 01:00:50.495445 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 01:00:50.521697 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 01:00:50.573972 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 01:00:50.607380 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 01:00:50.633837 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 01:00:51.182046 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 01:00:51.230897 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:00:51.241790 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:00:51.314203 tst mo_mt_call.py: using LAC 24891 01:00:51.431668 tst mo_mt_call.py: using RAC 156 01:00:51.558456 tst mo_mt_call.py: using CellId 24891 01:00:51.683357 tst mo_mt_call.py: using BVCI 24892 01:00:51.801669 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:00:51.813153 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:00:51.824188 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:00:51.835515 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:00:51.846804 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:00:51.858033 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:00:51.974725 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:00:52.094725 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:00:52.598264 run create_hlr_db(pid=5782): Launched 01:00:52.730995 bus /sierra_2: Setting Powered False 01:00:53.791714 run create_hlr_db(pid=5782): Terminated: ok {rc=0} 01:00:54.222140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5784): Launched 01:00:54.525776 run osmo-hlr_10.42.42.2(pid=5785): Launched 01:00:54.642814 run osmo-stp_10.42.42.5: Starting osmo-stp 01:00:55.167744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5787): Launched 01:00:55.471651 run osmo-stp_10.42.42.5(pid=5788): Launched 01:00:55.588903 run osmo-msc_10.42.42.6: Starting osmo-msc 01:00:56.138368 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5790): Launched 01:00:56.442810 run osmo-msc_10.42.42.6(pid=5791): Launched 01:00:56.614045 run osmo-stp_10.42.42.5(pid=5788): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5788)] 01:00:56.742558 run osmo-stp_10.42.42.5(pid=5788): stdout: | (launched: 2022-12-10_01:00:55.415867) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:56.870934 run osmo-stp_10.42.42.5(pid=5788): stderr: | 20221210010055587 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010055588 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010055588 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010055588 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010055589 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010055589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010055589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:56.997436 run osmo-stp_10.42.42.5(pid=5788): stdout: | (launched: 2022-12-10_01:00:55.415867) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:57.118631 run osmo-stp_10.42.42.5(pid=5788): stderr: | 20221210010055587 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010055588 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010055588 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010055588 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010055589 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010055589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010055589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:57.263344 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5788): Process ended prematurely: osmo-stp_10.42.42.5(pid=5788) [trial-2367↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5788)] [trial-2367↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 01:00:57.272406 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:00:57.299474 run osmo-hlr_10.42.42.2(pid=5785): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5785)] 01:00:57.348248 run osmo-hlr_10.42.42.2(pid=5785): stdout: | (launched: 2022-12-10_01:00:54.469960) 01:00:57.398421 run osmo-hlr_10.42.42.2(pid=5785): stderr: | 20221210010054646 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010054646 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010054646 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010054646 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010054646 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010054646 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010054658 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010054668 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010054668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010054668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:00:57.467881 run osmo-msc_10.42.42.6(pid=5791): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5791)] 01:00:57.516562 run osmo-msc_10.42.42.6(pid=5791): stdout: | (launched: 2022-12-10_01:00:56.386731) 01:00:57.566678 run osmo-msc_10.42.42.6(pid=5791): stderr: | 20221210010056656 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210010056656 DLGLOBAL DEBUG validating counter group 0x7f36f5dd9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210010056657 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210010056657 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210010056657 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210010056657 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210010056659 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210010056659 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210010056659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210010056659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:00:57.617488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5784): Terminating (SIGTERM) 01:00:57.657948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5787): Terminating (SIGTERM) 01:00:57.698443 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5790): Terminating (SIGTERM) 01:00:57.738948 --- ParallelTerminationStrategy: PID 5784 died... 01:00:57.758194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5784): Terminated: ok {rc=0} 01:00:57.803263 --- ParallelTerminationStrategy: PID 5787 died... 01:00:57.822182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5787): Terminated: ok {rc=0} 01:00:57.866906 --- ParallelTerminationStrategy: PID 5790 died... 01:00:57.885742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5790): Terminated: ok {rc=0} 01:00:57.972101 bus /sierra_3: Setting Powered False 01:00:59.071222 bus /sierra_3: Setting Powered False 01:01:00.186200 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 01:01:01.332510 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:01:01.345506 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:01:01.418260 tst mo_mt_call_osmux.py: using LAC 24892 01:01:01.576728 tst mo_mt_call_osmux.py: using RAC 157 01:01:01.708301 tst mo_mt_call_osmux.py: using CellId 24892 01:01:01.830478 tst mo_mt_call_osmux.py: using BVCI 24893 01:01:01.962030 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:01:01.974157 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:01:01.986104 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:01:02.000195 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:01:02.013645 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:01:02.025543 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:01:02.148248 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:01:02.269371 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:01:02.774263 run create_hlr_db(pid=5793): Launched 01:01:02.906912 bus /sierra_2: Setting Powered False 01:01:03.971215 run create_hlr_db(pid=5793): Terminated: ok {rc=0} 01:01:04.422114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5795): Launched 01:01:04.746036 run osmo-hlr_10.42.42.2(pid=5796): Launched 01:01:04.869441 run osmo-stp_10.42.42.5: Starting osmo-stp 01:01:05.433410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5798): Launched 01:01:05.758400 run osmo-stp_10.42.42.5(pid=5799): Launched 01:01:05.882900 run osmo-msc_10.42.42.6: Starting osmo-msc 01:01:06.470310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5801): Launched 01:01:06.795879 run osmo-msc_10.42.42.6(pid=5802): Launched 01:01:06.975833 run osmo-stp_10.42.42.5(pid=5799): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5799)] 01:01:07.112431 run osmo-stp_10.42.42.5(pid=5799): stdout: | (launched: 2022-12-10_01:01:05.698803) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:01:07.248753 run osmo-stp_10.42.42.5(pid=5799): stderr: | 20221210010105892 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010105892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010105892 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010105892 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010105893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010105893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010105893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:01:07.384487 run osmo-stp_10.42.42.5(pid=5799): stdout: | (launched: 2022-12-10_01:01:05.698803) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:01:07.513892 run osmo-stp_10.42.42.5(pid=5799): stderr: | 20221210010105892 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010105892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010105892 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010105892 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010105893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010105893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010105893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:01:07.668740 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5799): Process ended prematurely: osmo-stp_10.42.42.5(pid=5799) [trial-2367↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5799)] [trial-2367↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 01:01:07.678309 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 01:01:07.706034 run osmo-hlr_10.42.42.2(pid=5796): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5796)] 01:01:07.755958 run osmo-hlr_10.42.42.2(pid=5796): stdout: | (launched: 2022-12-10_01:01:04.686713) 01:01:07.807646 run osmo-hlr_10.42.42.2(pid=5796): stderr: | 20221210010104886 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010104886 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010104886 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010104886 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010104887 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010104887 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010104900 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010104910 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010104910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010104910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:01:07.879735 run osmo-msc_10.42.42.6(pid=5802): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5802)] 01:01:07.929874 run osmo-msc_10.42.42.6(pid=5802): stdout: | (launched: 2022-12-10_01:01:06.736102) 01:01:07.981296 run osmo-msc_10.42.42.6(pid=5802): stderr: | 20221210010107059 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210010107059 DLGLOBAL DEBUG validating counter group 0x7f0a8c69dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210010107059 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210010107059 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210010107060 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210010107060 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210010107063 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210010107064 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210010107064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210010107064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:01:08.033590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5795): Terminating (SIGTERM) 01:01:08.075491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5798): Terminating (SIGTERM) 01:01:08.116918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5801): Terminating (SIGTERM) 01:01:08.158750 --- ParallelTerminationStrategy: PID 5795 died... 01:01:08.178721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5795): Terminated: ok {rc=0} 01:01:08.224528 --- ParallelTerminationStrategy: PID 5798 died... 01:01:08.243929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5798): Terminated: ok {rc=0} 01:01:08.289983 --- ParallelTerminationStrategy: PID 5801 died... 01:01:08.309438 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5801): Terminated: ok {rc=0} 01:01:08.396229 bus /sierra_3: Setting Powered False 01:01:09.493936 bus /sierra_3: Setting Powered False 01:01:10.610043 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 01:01:11.867300 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:01:11.872529 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 01:01:11.906495 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 01:01:11.933940 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 01:01:11.986719 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 01:01:12.020149 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 01:01:12.046997 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 01:01:12.594752 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 01:01:12.645331 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:12.656590 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 01:01:12.707224 tst mo_mt_call.py: using LAC 24893 01:01:12.825989 tst mo_mt_call.py: using RAC 158 01:01:12.955842 tst mo_mt_call.py: using CellId 24893 01:01:13.084789 tst mo_mt_call.py: using BVCI 24894 01:01:13.196172 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:13.207206 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:13.217866 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:13.228746 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:13.239720 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:13.250719 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 01:01:13.364516 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 01:01:13.480027 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:01:13.986910 run create_hlr_db(pid=5809): Launched 01:01:14.120182 bus /sierra_2: Setting Powered False 01:01:15.184572 run create_hlr_db(pid=5809): Terminated: ok {rc=0} 01:01:15.617250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5811): Launched 01:01:15.943293 run osmo-hlr_10.42.42.2(pid=5812): Launched 01:01:16.098059 run osmo-stp_10.42.42.5: Starting osmo-stp 01:01:16.969836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5814): Launched 01:01:17.355929 run osmo-stp_10.42.42.5(pid=5815): Launched 01:01:17.563805 run osmo-msc_10.42.42.6: Starting osmo-msc 01:01:18.154599 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5817): Launched 01:01:18.479598 run osmo-msc_10.42.42.6(pid=5818): Launched 01:01:18.660797 run osmo-stp_10.42.42.5(pid=5815): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5815)] 01:01:18.797578 run osmo-stp_10.42.42.5(pid=5815): stdout: | (launched: 2022-12-10_01:01:17.291690) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:01:18.934422 run osmo-stp_10.42.42.5(pid=5815): stderr: | 20221210010117514 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010117514 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010117514 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010117515 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010117515 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010117515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010117515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:01:19.069498 run osmo-stp_10.42.42.5(pid=5815): stdout: | (launched: 2022-12-10_01:01:17.291690) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:01:19.198703 run osmo-stp_10.42.42.5(pid=5815): stderr: | 20221210010117514 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010117514 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010117514 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010117515 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010117515 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010117515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010117515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:01:19.353549 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5815): Process ended prematurely: osmo-stp_10.42.42.5(pid=5815) [trial-2367↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5815)] [trial-2367↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 01:01:19.363057 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 01:01:19.390510 run osmo-hlr_10.42.42.2(pid=5812): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5812)] 01:01:19.440258 run osmo-hlr_10.42.42.2(pid=5812): stdout: | (launched: 2022-12-10_01:01:15.880846) 01:01:19.491865 run osmo-hlr_10.42.42.2(pid=5812): stderr: | 20221210010116343 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010116344 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010116344 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010116344 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010116344 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010116345 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010116374 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010116392 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010116395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010116398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:01:19.564211 run osmo-msc_10.42.42.6(pid=5818): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5818)] 01:01:19.613868 run osmo-msc_10.42.42.6(pid=5818): stdout: | (launched: 2022-12-10_01:01:18.420485) 01:01:19.665246 run osmo-msc_10.42.42.6(pid=5818): stderr: | 20221210010118742 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210010118742 DLGLOBAL DEBUG validating counter group 0x7fbcfd056c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210010118742 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210010118742 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210010118742 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210010118743 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210010118744 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210010118745 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210010118745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210010118745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:01:19.716885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5811): Terminating (SIGTERM) 01:01:19.758632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5814): Terminating (SIGTERM) 01:01:19.800452 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5817): Terminating (SIGTERM) 01:01:19.842058 --- ParallelTerminationStrategy: PID 5811 died... 01:01:19.861812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5811): Terminated: ok {rc=0} 01:01:19.907495 --- ParallelTerminationStrategy: PID 5814 died... 01:01:19.926745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5814): Terminated: ok {rc=0} 01:01:19.972256 --- ParallelTerminationStrategy: PID 5817 died... 01:01:19.991894 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5817): Terminated: ok {rc=0} 01:01:20.078588 bus /sierra_3: Setting Powered False 01:01:21.177780 bus /sierra_3: Setting Powered False 01:01:22.293483 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 01:01:23.443249 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:23.455287 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 01:01:23.507694 tst mo_mt_call_osmux.py: using LAC 24894 01:01:23.633986 tst mo_mt_call_osmux.py: using RAC 159 01:01:23.752749 tst mo_mt_call_osmux.py: using CellId 24894 01:01:23.871375 tst mo_mt_call_osmux.py: using BVCI 24895 01:01:23.982633 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:23.993642 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:24.004292 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:24.015853 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:24.027354 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:24.038750 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 01:01:24.155208 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 01:01:24.273943 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:01:24.779115 run create_hlr_db(pid=5820): Launched 01:01:24.910527 bus /sierra_2: Setting Powered False 01:01:25.974524 run create_hlr_db(pid=5820): Terminated: ok {rc=0} 01:01:26.409039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5822): Launched 01:01:26.713877 run osmo-hlr_10.42.42.2(pid=5823): Launched 01:01:26.829478 run osmo-stp_10.42.42.5: Starting osmo-stp 01:01:27.362672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5825): Launched 01:01:27.666596 run osmo-stp_10.42.42.5(pid=5826): Launched 01:01:27.782967 run osmo-msc_10.42.42.6: Starting osmo-msc 01:01:28.332673 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5828): Launched 01:01:28.636827 run osmo-msc_10.42.42.6(pid=5829): Launched 01:01:28.807811 run osmo-stp_10.42.42.5(pid=5826): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5826)] 01:01:28.937253 run osmo-stp_10.42.42.5(pid=5826): stdout: | (launched: 2022-12-10_01:01:27.610758) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:01:29.066230 run osmo-stp_10.42.42.5(pid=5826): stderr: | 20221210010127782 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010127782 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010127782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010127783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010127783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010127783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010127783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:01:29.191960 run osmo-stp_10.42.42.5(pid=5826): stdout: | (launched: 2022-12-10_01:01:27.610758) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:01:29.312564 run osmo-stp_10.42.42.5(pid=5826): stderr: | 20221210010127782 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010127782 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010127782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010127783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010127783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010127783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010127783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:01:29.457129 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5826): Process ended prematurely: osmo-stp_10.42.42.5(pid=5826) [trial-2367↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5826)] [trial-2367↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 01:01:29.466002 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 01:01:29.492842 run osmo-hlr_10.42.42.2(pid=5823): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5823)] 01:01:29.540513 run osmo-hlr_10.42.42.2(pid=5823): stdout: | (launched: 2022-12-10_01:01:26.657483) 01:01:29.589898 run osmo-hlr_10.42.42.2(pid=5823): stderr: | 20221210010126833 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010126833 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010126833 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010126833 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010126833 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010126833 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010126846 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010126856 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010126857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010126857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:01:29.658653 run osmo-msc_10.42.42.6(pid=5829): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5829)] 01:01:29.706325 run osmo-msc_10.42.42.6(pid=5829): stdout: | (launched: 2022-12-10_01:01:28.580882) 01:01:29.755659 run osmo-msc_10.42.42.6(pid=5829): stderr: | 20221210010128854 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210010128854 DLGLOBAL DEBUG validating counter group 0x7f9d4ff34c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210010128854 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210010128854 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210010128854 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210010128855 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210010128856 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210010128857 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210010128857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210010128857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:01:29.805330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5822): Terminating (SIGTERM) 01:01:29.845013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5825): Terminating (SIGTERM) 01:01:29.884616 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5828): Terminating (SIGTERM) 01:01:29.924392 --- ParallelTerminationStrategy: PID 5822 died... 01:01:29.943418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5822): Terminated: ok {rc=0} 01:01:29.987369 --- ParallelTerminationStrategy: PID 5825 died... 01:01:30.005829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5825): Terminated: ok {rc=0} 01:01:30.050075 --- ParallelTerminationStrategy: PID 5828 died... 01:01:30.069107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5828): Terminated: ok {rc=0} 01:01:30.155885 bus /sierra_3: Setting Powered False 01:01:31.254145 bus /sierra_3: Setting Powered False 01:01:32.368883 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 01:01:33.620443 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:01:33.628731 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 01:01:33.662944 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 01:01:33.689428 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 01:01:33.739241 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 01:01:33.772210 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 01:01:33.798355 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 01:01:34.352586 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 01:01:34.401657 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:01:34.412819 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:01:34.463309 tst mo_mt_call.py: using LAC 24895 01:01:34.581895 tst mo_mt_call.py: using RAC 160 01:01:34.701070 tst mo_mt_call.py: using CellId 24895 01:01:34.817622 tst mo_mt_call.py: using BVCI 24896 01:01:34.937817 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:01:34.949685 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:01:34.961197 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:01:34.972656 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:01:34.984488 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:01:34.996041 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:01:35.111813 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:01:35.230862 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:01:35.735345 run create_hlr_db(pid=5835): Launched 01:01:35.867941 bus /sierra_2: Setting Powered False 01:01:36.932888 run create_hlr_db(pid=5835): Terminated: ok {rc=0} 01:01:37.385436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5837): Launched 01:01:37.712317 run osmo-hlr_10.42.42.2(pid=5838): Launched 01:01:37.836053 run osmo-stp_10.42.42.5: Starting osmo-stp 01:01:38.397222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5840): Launched 01:01:38.722262 run osmo-stp_10.42.42.5(pid=5841): Launched 01:01:38.848741 run osmo-msc_10.42.42.6: Starting osmo-msc 01:01:39.436372 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5843): Launched 01:01:39.761861 run osmo-msc_10.42.42.6(pid=5844): Launched 01:01:39.942976 run osmo-stp_10.42.42.5(pid=5841): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5841)] 01:01:40.081297 run osmo-stp_10.42.42.5(pid=5841): stdout: | (launched: 2022-12-10_01:01:38.662944) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:01:40.219050 run osmo-stp_10.42.42.5(pid=5841): stderr: | 20221210010138855 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010138855 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010138855 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010138855 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010138856 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010138856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010138856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:01:40.355648 run osmo-stp_10.42.42.5(pid=5841): stdout: | (launched: 2022-12-10_01:01:38.662944) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:01:40.484722 run osmo-stp_10.42.42.5(pid=5841): stderr: | 20221210010138855 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010138855 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010138855 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010138855 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010138856 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010138856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010138856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:01:40.640081 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5841): Process ended prematurely: osmo-stp_10.42.42.5(pid=5841) [trial-2367↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5841)] [trial-2367↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 01:01:40.649638 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 01:01:40.677328 run osmo-hlr_10.42.42.2(pid=5838): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5838)] 01:01:40.727273 run osmo-hlr_10.42.42.2(pid=5838): stdout: | (launched: 2022-12-10_01:01:37.652681) 01:01:40.779080 run osmo-hlr_10.42.42.2(pid=5838): stderr: | 20221210010137852 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010137852 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010137852 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010137852 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010137852 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010137852 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010137889 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010137898 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010137899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010137899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:01:40.851518 run osmo-msc_10.42.42.6(pid=5844): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5844)] 01:01:40.901361 run osmo-msc_10.42.42.6(pid=5844): stdout: | (launched: 2022-12-10_01:01:39.702162) 01:01:40.953120 run osmo-msc_10.42.42.6(pid=5844): stderr: | 20221210010140026 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210010140027 DLGLOBAL DEBUG validating counter group 0x7ff663b30c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210010140027 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210010140027 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210010140027 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210010140027 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210010140029 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210010140029 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210010140029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210010140029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:01:41.005121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5837): Terminating (SIGTERM) 01:01:41.046859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5840): Terminating (SIGTERM) 01:01:41.089089 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5843): Terminating (SIGTERM) 01:01:41.131252 --- ParallelTerminationStrategy: PID 5837 died... 01:01:41.151314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5837): Terminated: ok {rc=0} 01:01:41.197467 --- ParallelTerminationStrategy: PID 5840 died... 01:01:41.216827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5840): Terminated: ok {rc=0} 01:01:41.262778 --- ParallelTerminationStrategy: PID 5843 died... 01:01:41.282260 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5843): Terminated: ok {rc=0} 01:01:41.369607 bus /sierra_3: Setting Powered False 01:01:42.469288 bus /sierra_3: Setting Powered False 01:01:43.588883 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 01:01:44.733868 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:01:44.745925 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:01:44.798585 tst mo_mt_call_osmux.py: using LAC 24896 01:01:44.915748 tst mo_mt_call_osmux.py: using RAC 161 01:01:45.032585 tst mo_mt_call_osmux.py: using CellId 24896 01:01:45.150198 tst mo_mt_call_osmux.py: using BVCI 24897 01:01:45.261506 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:01:45.272646 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:01:45.283781 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:01:45.295270 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:01:45.306735 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:01:45.318056 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:01:45.437167 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:01:45.556486 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:01:46.054022 run create_hlr_db(pid=5846): Launched 01:01:46.228716 bus /sierra_2: Setting Powered False 01:01:47.293904 run create_hlr_db(pid=5846): Terminated: ok {rc=0} 01:01:47.758326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5848): Launched 01:01:48.061794 run osmo-hlr_10.42.42.2(pid=5849): Launched 01:01:48.177433 run osmo-stp_10.42.42.5: Starting osmo-stp 01:01:48.712748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5851): Launched 01:01:49.016259 run osmo-stp_10.42.42.5(pid=5852): Launched 01:01:49.131950 run osmo-msc_10.42.42.6: Starting osmo-msc 01:01:49.680151 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5854): Launched 01:01:49.983980 run osmo-msc_10.42.42.6(pid=5855): Launched 01:01:50.154227 run osmo-stp_10.42.42.5(pid=5852): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5852)] 01:01:50.283675 run osmo-stp_10.42.42.5(pid=5852): stdout: | (launched: 2022-12-10_01:01:48.960308) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:01:50.412389 run osmo-stp_10.42.42.5(pid=5852): stderr: | 20221210010149132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010149132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010149133 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010149133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010149133 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010149133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010149133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:01:50.538244 run osmo-stp_10.42.42.5(pid=5852): stdout: | (launched: 2022-12-10_01:01:48.960308) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:01:50.659070 run osmo-stp_10.42.42.5(pid=5852): stderr: | 20221210010149132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010149132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010149133 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010149133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010149133 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010149133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010149133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:01:50.803393 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5852): Process ended prematurely: osmo-stp_10.42.42.5(pid=5852) [trial-2367↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5852)] [trial-2367↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 01:01:50.812467 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 01:01:50.839602 run osmo-hlr_10.42.42.2(pid=5849): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5849)] 01:01:50.887670 run osmo-hlr_10.42.42.2(pid=5849): stdout: | (launched: 2022-12-10_01:01:48.005977) 01:01:50.937464 run osmo-hlr_10.42.42.2(pid=5849): stderr: | 20221210010148186 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010148186 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010148186 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010148186 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010148186 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010148186 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010148202 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010148212 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010148212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010148212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:01:51.006899 run osmo-msc_10.42.42.6(pid=5855): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5855)] 01:01:51.055021 run osmo-msc_10.42.42.6(pid=5855): stdout: | (launched: 2022-12-10_01:01:49.927988) 01:01:51.104824 run osmo-msc_10.42.42.6(pid=5855): stderr: | 20221210010150200 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210010150200 DLGLOBAL DEBUG validating counter group 0x7fb4217bfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210010150200 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210010150201 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210010150201 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210010150201 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210010150203 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210010150203 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210010150203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210010150203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:01:51.155079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5848): Terminating (SIGTERM) 01:01:51.195132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5851): Terminating (SIGTERM) 01:01:51.235233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5854): Terminating (SIGTERM) 01:01:51.275420 --- ParallelTerminationStrategy: PID 5848 died... 01:01:51.294588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5848): Terminated: ok {rc=0} 01:01:51.339094 --- ParallelTerminationStrategy: PID 5851 died... 01:01:51.357729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5851): Terminated: ok {rc=0} 01:01:51.401885 --- ParallelTerminationStrategy: PID 5854 died... 01:01:51.420441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5854): Terminated: ok {rc=0} 01:01:51.506365 bus /sierra_3: Setting Powered False 01:01:52.606925 bus /sierra_3: Setting Powered False 01:01:53.721910 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 emergency:trx-b200 --------------------------------------------------------------------- 01:01:54.970936 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:01:54.975221 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 01:01:55.008703 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 01:01:55.035509 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 01:01:55.119365 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 01:01:55.153483 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 01:01:55.180712 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 01:01:55.766663 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2367 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 01:01:55.771996 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:01:55.783226 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 01:01:55.833375 tst emergency_mo_mt_call.py: using LAC 24897 01:01:55.957114 tst emergency_mo_mt_call.py: using RAC 162 01:01:56.081090 tst emergency_mo_mt_call.py: using CellId 24897 01:01:56.204282 tst emergency_mo_mt_call.py: using BVCI 24898 01:01:56.323002 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:01:56.334231 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:01:56.345193 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:01:56.356140 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:01:56.367541 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:01:56.378451 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 01:01:56.493194 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 01:01:56.608344 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:01:57.071920 run create_hlr_db(pid=5860): Launched 01:01:57.188378 bus /sierra_2: Setting Powered False 01:01:58.248513 run create_hlr_db(pid=5860): Terminated: ok {rc=0} 01:01:58.667087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5862): Launched 01:01:58.965986 run osmo-hlr_10.42.42.2(pid=5863): Launched 01:01:59.079912 run osmo-stp_10.42.42.5: Starting osmo-stp 01:01:59.589757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5865): Launched 01:01:59.887506 run osmo-stp_10.42.42.5(pid=5866): Launched 01:02:00.021212 tst emergency_mo_mt_call.py: using MSISDN 7471 01:02:00.174321 run osmo-msc_10.42.42.6: Starting osmo-msc 01:02:00.713687 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5868): Launched 01:02:01.059720 run osmo-msc_10.42.42.6(pid=5869): Launched 01:02:01.455305 run osmo-stp_10.42.42.5(pid=5866): ERR: Terminated: ERROR {rc=1} [trial-2367↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5866)] 01:02:01.829684 run osmo-stp_10.42.42.5(pid=5866): stdout: | (launched: 2022-12-10_01:01:59.832403) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:02:01.968780 run osmo-stp_10.42.42.5(pid=5866): stderr: | 20221210010200000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010200001 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010200001 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010200001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010200002 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010200002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010200002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:02:02.097856 run osmo-stp_10.42.42.5(pid=5866): stdout: | (launched: 2022-12-10_01:01:59.832403) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:02:02.218810 run osmo-stp_10.42.42.5(pid=5866): stderr: | 20221210010200000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010200001 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010200001 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010200001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010200002 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010200002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010200002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:02:02.363997 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=5866): Process ended prematurely: osmo-stp_10.42.42.5(pid=5866) [trial-2367↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5866)] [trial-2367↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 01:02:02.373884 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 01:02:02.401365 run osmo-hlr_10.42.42.2(pid=5863): ERR: Terminated: ERROR {rc=237} [trial-2367↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5863)] 01:02:02.449501 run osmo-hlr_10.42.42.2(pid=5863): stdout: | (launched: 2022-12-10_01:01:58.910744) 01:02:02.499234 run osmo-hlr_10.42.42.2(pid=5863): stderr: | 20221210010159088 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010159088 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010159088 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010159088 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010159088 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010159088 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010159119 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010159130 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010159130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010159130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:02:02.569190 run osmo-msc_10.42.42.6(pid=5869): ERR: Terminated: ERROR {rc=2} [trial-2367↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5869)] 01:02:02.617207 run osmo-msc_10.42.42.6(pid=5869): stdout: | (launched: 2022-12-10_01:02:00.999764) 01:02:02.666762 run osmo-msc_10.42.42.6(pid=5869): stderr: | 20221210010201436 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210010201436 DLGLOBAL DEBUG validating counter group 0x7fbd1df32c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210010201436 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210010201436 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210010201437 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210010201438 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210010201442 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210010201443 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210010201443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210010201443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:02:02.716682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5862): Terminating (SIGTERM) 01:02:02.756447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5865): Terminating (SIGTERM) 01:02:02.796464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5868): Terminating (SIGTERM) 01:02:02.836869 --- ParallelTerminationStrategy: PID 5862 died... 01:02:02.856050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5862): Terminated: ok {rc=0} 01:02:02.900805 --- ParallelTerminationStrategy: PID 5865 died... 01:02:02.919626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5865): Terminated: ok {rc=0} 01:02:02.963942 --- ParallelTerminationStrategy: PID 5868 died... 01:02:02.982733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5868): Terminated: ok {rc=0} 01:02:03.069987 bus /sierra_3: Setting Powered False 01:02:04.170564 bus /sierra_3: Setting Powered False 01:02:05.284921 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 01:02:06.372249 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:02:06.384067 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 01:02:06.437972 tst emergency_preemptive_call.py: using LAC 24898 01:02:06.565309 tst emergency_preemptive_call.py: using RAC 163 01:02:06.692685 tst emergency_preemptive_call.py: using CellId 24898 01:02:06.820270 tst emergency_preemptive_call.py: using BVCI 24899 01:02:06.937407 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:02:06.948409 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:02:06.959356 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:02:06.970817 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:02:06.982267 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:02:06.993664 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 01:02:07.108519 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 01:02:07.228227 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 01:02:07.342140 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 01:02:07.455168 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:02:07.918678 run create_hlr_db(pid=5871): Launched 01:02:08.032908 bus /sierra_2: Setting Powered False 01:02:09.092669 run create_hlr_db(pid=5871): Terminated: ok {rc=0} 01:02:09.508514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5873): Launched 01:02:09.807430 run osmo-hlr_10.42.42.2(pid=5874): Launched 01:02:09.921851 run osmo-stp_10.42.42.5: Starting osmo-stp 01:02:10.450065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5876): Launched 01:02:10.748342 run osmo-stp_10.42.42.5(pid=5877): Launched 01:02:10.872759 tst emergency_preemptive_call.py: using MSISDN 7472 01:02:11.025381 run osmo-msc_10.42.42.6: Starting osmo-msc 01:02:11.559639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5879): Launched 01:02:11.858045 run osmo-msc_10.42.42.6(pid=5880): Launched 01:02:12.026205 run osmo-stp_10.42.42.5(pid=5877): ERR: Terminated: ERROR {rc=1} [trial-2367↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5877)] 01:02:12.153229 run osmo-stp_10.42.42.5(pid=5877): stdout: | (launched: 2022-12-10_01:02:10.693150) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:02:12.279490 run osmo-stp_10.42.42.5(pid=5877): stderr: | 20221210010210862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010210862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010210862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010210862 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010210863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010210863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010210863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:02:12.404357 run osmo-stp_10.42.42.5(pid=5877): stdout: | (launched: 2022-12-10_01:02:10.693150) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:02:12.523081 run osmo-stp_10.42.42.5(pid=5877): stderr: | 20221210010210862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010210862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010210862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010210862 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010210863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010210863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010210863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:02:12.665190 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=5877): Process ended prematurely: osmo-stp_10.42.42.5(pid=5877) [trial-2367↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5877)] [trial-2367↪emergency:trx-b200↪emergency_preemptive_call.py:32] 01:02:12.673678 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 01:02:12.700594 run osmo-hlr_10.42.42.2(pid=5874): ERR: Terminated: ERROR {rc=237} [trial-2367↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5874)] 01:02:12.749155 run osmo-hlr_10.42.42.2(pid=5874): stdout: | (launched: 2022-12-10_01:02:09.752210) 01:02:12.799169 run osmo-hlr_10.42.42.2(pid=5874): stderr: | 20221210010209928 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010209928 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010209928 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010209928 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010209928 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010209928 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010209940 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010209949 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010209949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010209949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:02:12.869426 run osmo-msc_10.42.42.6(pid=5880): ERR: Terminated: ERROR {rc=2} [trial-2367↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5880)] 01:02:12.917621 run osmo-msc_10.42.42.6(pid=5880): stdout: | (launched: 2022-12-10_01:02:11.802691) 01:02:12.967524 run osmo-msc_10.42.42.6(pid=5880): stderr: | 20221210010212075 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210010212075 DLGLOBAL DEBUG validating counter group 0x7f2301badc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210010212075 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210010212075 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210010212075 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210010212075 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210010212078 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210010212078 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210010212078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210010212078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:02:13.017616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5873): Terminating (SIGTERM) 01:02:13.057798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5876): Terminating (SIGTERM) 01:02:13.098008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5879): Terminating (SIGTERM) 01:02:13.138376 --- ParallelTerminationStrategy: PID 5873 died... 01:02:13.157691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5873): Terminated: ok {rc=0} 01:02:13.202568 --- ParallelTerminationStrategy: PID 5876 died... 01:02:13.221153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5876): Terminated: ok {rc=0} 01:02:13.265604 --- ParallelTerminationStrategy: PID 5879 died... 01:02:13.284113 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5879): Terminated: ok {rc=0} 01:02:13.369703 bus /sierra_9: Setting Powered False 01:02:14.468107 bus /sierra_9: Setting Powered False 01:02:15.582964 bus /sierra_8: Setting Powered False 01:02:16.685865 bus /sierra_8: Setting Powered False 01:02:17.802212 bus /sierra_3: Setting Powered False 01:02:18.900483 bus /sierra_3: Setting Powered False 01:02:20.017234 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:trx-b200 --------------------------------------------------------------------- 01:02:21.303812 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:02:21.308386 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 01:02:21.342533 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 01:02:21.381685 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 01:02:21.471556 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 01:02:21.505505 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 01:02:21.544320 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 01:02:22.136565 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 01:02:22.189783 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:22.200580 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 01:02:22.251393 tst cs_paging_gprs_active.py: using LAC 24899 01:02:22.380035 tst cs_paging_gprs_active.py: using RAC 164 01:02:22.507684 tst cs_paging_gprs_active.py: using CellId 24899 01:02:22.637579 tst cs_paging_gprs_active.py: using BVCI 24900 01:02:22.756326 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:22.767435 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:22.778267 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:22.789176 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:22.799879 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:22.810637 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:22.821590 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:22.832232 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:22.843170 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 01:02:22.962383 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 01:02:23.081892 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:02:23.302634 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:02:23.629704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5885): Launched 01:02:23.914921 run iperf3-srv_10.42.42.10(pid=5886): Launched 01:02:24.037505 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:02:24.257402 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:02:24.584927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5887): Launched 01:02:24.868709 run iperf3-srv_10.42.42.10(pid=5888): Launched 01:02:24.990761 tst cs_paging_gprs_active.py:38: start network... 01:02:25.210538 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:02:25.715727 run create_hlr_db(pid=5889): Launched 01:02:25.848713 bus /sierra_2: Setting Powered False 01:02:26.909573 run create_hlr_db(pid=5889): Terminated: ok {rc=0} 01:02:27.362487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5891): Launched 01:02:27.688854 run osmo-hlr_10.42.42.2(pid=5892): Launched 01:02:27.813458 run osmo-stp_10.42.42.5: Starting osmo-stp 01:02:28.373928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5894): Launched 01:02:28.700801 run osmo-stp_10.42.42.5(pid=5895): Launched 01:02:28.825647 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:02:29.388273 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5897): Launched 01:02:29.513522 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:02:29.788730 run patchelf(pid=5898): Launched 01:02:29.971184 run osmo-stp_10.42.42.5(pid=5895): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5895)] 01:02:30.109167 run osmo-stp_10.42.42.5(pid=5895): stdout: | (launched: 2022-12-10_01:02:28.641321) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:02:30.248320 run osmo-stp_10.42.42.5(pid=5895): stderr: | 20221210010228834 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010228834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010228834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010228834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010228835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010228835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010228835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:02:30.387851 run osmo-stp_10.42.42.5(pid=5895): stdout: | (launched: 2022-12-10_01:02:28.641321) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:02:30.521515 run osmo-stp_10.42.42.5(pid=5895): stderr: | 20221210010228834 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010228834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010228834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010228834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010228835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010228835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010228835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:02:30.680183 run patchelf(pid=5898): Terminating (SIGINT) 01:02:30.867286 run patchelf(pid=5898): Terminated: ok {rc=0} 01:02:31.032757 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5895): Process ended prematurely: osmo-stp_10.42.42.5(pid=5895) [trial-2367↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5895)] [trial-2367↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 01:02:31.044073 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 01:02:31.074529 run osmo-hlr_10.42.42.2(pid=5892): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5892)] 01:02:31.126764 run osmo-hlr_10.42.42.2(pid=5892): stdout: | (launched: 2022-12-10_01:02:27.628442) 01:02:31.180171 run osmo-hlr_10.42.42.2(pid=5892): stderr: | 20221210010227827 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010227828 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010227828 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010227828 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010227828 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010227828 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010227852 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010227862 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010227862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010227862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:02:31.233561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5885): Terminating (SIGTERM) 01:02:31.276898 run iperf3-srv_10.42.42.10(pid=5886): Terminating (SIGTERM) 01:02:31.321136 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5887): Terminating (SIGTERM) 01:02:31.364485 run iperf3-srv_10.42.42.10(pid=5888): Terminating (SIGTERM) 01:02:31.407922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5891): Terminating (SIGTERM) 01:02:31.451465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5894): Terminating (SIGTERM) 01:02:31.495980 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5897): Terminating (SIGTERM) 01:02:31.539563 --- ParallelTerminationStrategy: PID 5885 died... 01:02:31.559880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5885): Terminated: ok {rc=0} 01:02:31.607463 --- ParallelTerminationStrategy: PID 5886 died... 01:02:31.627568 run iperf3-srv_10.42.42.10(pid=5886): Terminated {rc=256} 01:02:31.674442 --- ParallelTerminationStrategy: PID 5887 died... 01:02:31.694504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5887): Terminated: ok {rc=0} 01:02:31.741305 --- ParallelTerminationStrategy: PID 5888 died... 01:02:31.761554 run iperf3-srv_10.42.42.10(pid=5888): Terminated {rc=256} 01:02:31.808408 --- ParallelTerminationStrategy: PID 5891 died... 01:02:31.828540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5891): Terminated: ok {rc=0} 01:02:31.875435 --- ParallelTerminationStrategy: PID 5894 died... 01:02:31.895580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5894): Terminated: ok {rc=0} 01:02:31.942358 --- ParallelTerminationStrategy: PID 5897 died... 01:02:31.962477 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5897): Terminated: ok {rc=0} 01:02:32.051917 bus /gobi_0: Setting Powered False 01:02:33.152149 bus /gobi_0: Setting Powered False 01:02:34.267992 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-b200 iperf3.py ---------------------------------------------- 01:02:35.420019 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:35.431807 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 01:02:35.488142 tst iperf3.py: using LAC 24900 01:02:35.608362 tst iperf3.py: using RAC 165 01:02:35.727727 tst iperf3.py: using CellId 24900 01:02:35.847061 tst iperf3.py: using BVCI 24901 01:02:35.961717 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:35.972411 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:35.983097 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:35.994278 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:36.005249 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:36.016082 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:36.027134 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:36.038209 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:36.049387 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 01:02:36.169147 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:02:36.389056 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:02:36.716867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5900): Launched 01:02:37.000143 run iperf3-srv_10.42.42.10(pid=5901): Launched 01:02:37.123414 tst iperf3.py:8: start network... 01:02:37.342543 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:02:37.846267 run create_hlr_db(pid=5902): Launched 01:02:37.978996 bus /gobi_6: Setting Powered False 01:02:39.042478 run create_hlr_db(pid=5902): Terminated: ok {rc=0} 01:02:39.495570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5904): Launched 01:02:39.821123 run osmo-hlr_10.42.42.2(pid=5905): Launched 01:02:39.946343 run osmo-stp_10.42.42.5: Starting osmo-stp 01:02:40.508439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5907): Launched 01:02:40.834617 run osmo-stp_10.42.42.5(pid=5908): Launched 01:02:40.959338 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:02:41.519442 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5910): Launched 01:02:41.643584 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:02:41.917639 run patchelf(pid=5911): Launched 01:02:42.099140 run osmo-stp_10.42.42.5(pid=5908): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5908)] 01:02:42.237249 run osmo-stp_10.42.42.5(pid=5908): stdout: | (launched: 2022-12-10_01:02:40.775206) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:02:42.376289 run osmo-stp_10.42.42.5(pid=5908): stderr: | 20221210010240968 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010240968 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010240968 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010240969 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010240969 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010240969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010240969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:02:42.515538 run osmo-stp_10.42.42.5(pid=5908): stdout: | (launched: 2022-12-10_01:02:40.775206) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:02:42.649729 run osmo-stp_10.42.42.5(pid=5908): stderr: | 20221210010240968 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010240968 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010240968 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010240969 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010240969 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010240969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010240969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:02:42.808001 run patchelf(pid=5911): Terminating (SIGINT) 01:02:42.989485 run patchelf(pid=5911): Terminated: ok {rc=0} 01:02:43.120751 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5908): Process ended prematurely: osmo-stp_10.42.42.5(pid=5908) [trial-2367↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5908)] [trial-2367↪gprs:trx-b200↪iperf3.py:8] 01:02:43.130977 tst iperf3.py:8: Test FAILED (7.7 sec) 01:02:43.159436 run osmo-hlr_10.42.42.2(pid=5905): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5905)] 01:02:43.209471 run osmo-hlr_10.42.42.2(pid=5905): stdout: | (launched: 2022-12-10_01:02:39.761553) 01:02:43.261069 run osmo-hlr_10.42.42.2(pid=5905): stderr: | 20221210010239964 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010239964 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010239964 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010239964 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010239964 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010239964 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010239982 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010239991 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010239991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010239991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:02:43.313171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5900): Terminating (SIGTERM) 01:02:43.354945 run iperf3-srv_10.42.42.10(pid=5901): Terminating (SIGTERM) 01:02:43.396655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5904): Terminating (SIGTERM) 01:02:43.438560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5907): Terminating (SIGTERM) 01:02:43.480340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5910): Terminating (SIGTERM) 01:02:43.522385 --- ParallelTerminationStrategy: PID 5900 died... 01:02:43.542370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5900): Terminated: ok {rc=0} 01:02:43.588822 --- ParallelTerminationStrategy: PID 5901 died... 01:02:43.608356 run iperf3-srv_10.42.42.10(pid=5901): Terminated {rc=256} 01:02:43.654111 --- ParallelTerminationStrategy: PID 5904 died... 01:02:43.673510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5904): Terminated: ok {rc=0} 01:02:43.719407 --- ParallelTerminationStrategy: PID 5907 died... 01:02:43.738857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5907): Terminated: ok {rc=0} 01:02:43.784727 --- ParallelTerminationStrategy: PID 5910 died... 01:02:43.804255 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5910): Terminated: ok {rc=0} 01:02:43.891758 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 01:02:45.042576 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:45.054499 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 01:02:45.105330 tst iperf3m4.py: using LAC 24901 01:02:45.234646 tst iperf3m4.py: using RAC 166 01:02:45.363258 tst iperf3m4.py: using CellId 24901 01:02:45.490549 tst iperf3m4.py: using BVCI 24902 01:02:45.609873 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:45.621062 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:45.632044 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:45.643018 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:45.653946 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:45.664753 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:45.675788 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:45.686739 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:45.697837 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 01:02:45.817564 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 01:02:45.956919 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 01:02:46.076214 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 01:02:46.208434 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:02:46.437459 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:02:46.769713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5912): Launched 01:02:47.063596 run iperf3-srv_10.42.42.10(pid=5913): Launched 01:02:47.201885 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:02:47.422940 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:02:47.750375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5914): Launched 01:02:48.033663 run iperf3-srv_10.42.42.10(pid=5915): Launched 01:02:48.157630 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:02:48.378207 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:02:48.706465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5916): Launched 01:02:48.989748 run iperf3-srv_10.42.42.10(pid=5917): Launched 01:02:49.111677 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:02:49.330472 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:02:49.655575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5918): Launched 01:02:49.938170 run iperf3-srv_10.42.42.10(pid=5919): Launched 01:02:50.060159 tst iperf3m4.py:8: start network... 01:02:50.279241 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:02:50.784367 run create_hlr_db(pid=5920): Launched 01:02:50.916518 bus /gobi_6: Setting Powered False 01:02:51.978586 run create_hlr_db(pid=5920): Terminated: ok {rc=0} 01:02:52.434481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5922): Launched 01:02:52.761286 run osmo-hlr_10.42.42.2(pid=5923): Launched 01:02:52.884702 run osmo-stp_10.42.42.5: Starting osmo-stp 01:02:53.444881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5925): Launched 01:02:53.770604 run osmo-stp_10.42.42.5(pid=5926): Launched 01:02:53.895394 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:02:54.456520 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5928): Launched 01:02:54.581136 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:02:54.856667 run patchelf(pid=5929): Launched 01:02:55.038074 run osmo-stp_10.42.42.5(pid=5926): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5926)] 01:02:55.176503 run osmo-stp_10.42.42.5(pid=5926): stdout: | (launched: 2022-12-10_01:02:53.710873) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:02:55.316116 run osmo-stp_10.42.42.5(pid=5926): stderr: | 20221210010253903 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010253903 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010253903 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010253904 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010253904 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010253904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010253904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:02:55.455416 run osmo-stp_10.42.42.5(pid=5926): stdout: | (launched: 2022-12-10_01:02:53.710873) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:02:55.589990 run osmo-stp_10.42.42.5(pid=5926): stderr: | 20221210010253903 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010253903 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010253903 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010253904 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010253904 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010253904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010253904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:02:55.748687 run patchelf(pid=5929): Terminating (SIGINT) 01:02:55.930476 run patchelf(pid=5929): Terminated: ok {rc=0} 01:02:56.061459 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5926): Process ended prematurely: osmo-stp_10.42.42.5(pid=5926) [trial-2367↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5926)] [trial-2367↪gprs:trx-b200↪iperf3m4.py:8] 01:02:56.071536 tst iperf3m4.py:8: Test FAILED (11.1 sec) 01:02:56.100439 run osmo-hlr_10.42.42.2(pid=5923): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5923)] 01:02:56.150879 run osmo-hlr_10.42.42.2(pid=5923): stdout: | (launched: 2022-12-10_01:02:52.701137) 01:02:56.203035 run osmo-hlr_10.42.42.2(pid=5923): stderr: | 20221210010252903 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010252903 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010252903 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010252903 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010252903 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010252903 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010252929 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010252939 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010252939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010252939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:02:56.255354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5912): Terminating (SIGTERM) 01:02:56.297474 run iperf3-srv_10.42.42.10(pid=5913): Terminating (SIGTERM) 01:02:56.339444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5914): Terminating (SIGTERM) 01:02:56.381635 run iperf3-srv_10.42.42.10(pid=5915): Terminating (SIGTERM) 01:02:56.423724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5916): Terminating (SIGTERM) 01:02:56.466019 run iperf3-srv_10.42.42.10(pid=5917): Terminating (SIGTERM) 01:02:56.508009 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5918): Terminating (SIGTERM) 01:02:56.550286 run iperf3-srv_10.42.42.10(pid=5919): Terminating (SIGTERM) 01:02:56.592404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5922): Terminating (SIGTERM) 01:02:56.634584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5925): Terminating (SIGTERM) 01:02:56.676658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5928): Terminating (SIGTERM) 01:02:56.719428 --- ParallelTerminationStrategy: PID 5912 died... 01:02:56.739511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5912): Terminated: ok {rc=0} 01:02:56.786863 --- ParallelTerminationStrategy: PID 5913 died... 01:02:56.806581 run iperf3-srv_10.42.42.10(pid=5913): Terminated {rc=256} 01:02:56.852875 --- ParallelTerminationStrategy: PID 5914 died... 01:02:56.873012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5914): Terminated: ok {rc=0} 01:02:56.919326 --- ParallelTerminationStrategy: PID 5915 died... 01:02:56.939068 run iperf3-srv_10.42.42.10(pid=5915): Terminated {rc=256} 01:02:56.985162 --- ParallelTerminationStrategy: PID 5916 died... 01:02:57.004568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5916): Terminated: ok {rc=0} 01:02:57.050824 --- ParallelTerminationStrategy: PID 5917 died... 01:02:57.070535 run iperf3-srv_10.42.42.10(pid=5917): Terminated {rc=256} 01:02:57.116652 --- ParallelTerminationStrategy: PID 5918 died... 01:02:57.136652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5918): Terminated: ok {rc=0} 01:02:57.182961 --- ParallelTerminationStrategy: PID 5919 died... 01:02:57.202643 run iperf3-srv_10.42.42.10(pid=5919): Terminated {rc=256} 01:02:57.248497 --- ParallelTerminationStrategy: PID 5922 died... 01:02:57.268270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5922): Terminated: ok {rc=0} 01:02:57.314517 --- ParallelTerminationStrategy: PID 5925 died... 01:02:57.334359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5925): Terminated: ok {rc=0} 01:02:57.380648 --- ParallelTerminationStrategy: PID 5928 died... 01:02:57.400513 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5928): Terminated: ok {rc=0} 01:02:57.488931 bus /gobi_4: Setting Powered False 01:02:58.587741 bus /gobi_4: Setting Powered False 01:02:59.705633 bus /gobi_1: Setting Powered False 01:03:00.804761 bus /gobi_1: Setting Powered False 01:03:01.944715 bus /gobi_0: Setting Powered False 01:03:03.066834 bus /gobi_0: Setting Powered False 01:03:04.186696 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-b200 ping.py ---------------------------------------------- 01:03:05.291646 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:05.303064 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 01:03:05.352488 tst ping.py: using LAC 24902 01:03:05.471248 tst ping.py: using RAC 167 01:03:05.588215 tst ping.py: using CellId 24902 01:03:05.709284 tst ping.py: using BVCI 24903 01:03:05.819647 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:05.830284 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:05.840773 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:05.851526 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:05.862133 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:05.872653 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:05.883476 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:05.894162 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 01:03:06.013454 tst ping.py:19: start network... 01:03:06.230559 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:03:06.725360 run create_hlr_db(pid=5931): Launched 01:03:06.856005 bus /gobi_6: Setting Powered False 01:03:07.918260 run create_hlr_db(pid=5931): Terminated: ok {rc=0} 01:03:08.343956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5933): Launched 01:03:08.644721 run osmo-hlr_10.42.42.2(pid=5934): Launched 01:03:08.759865 run osmo-stp_10.42.42.5: Starting osmo-stp 01:03:09.289949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5936): Launched 01:03:09.590027 run osmo-stp_10.42.42.5(pid=5937): Launched 01:03:09.703049 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:03:10.215292 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5939): Launched 01:03:10.329343 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:03:10.580552 run patchelf(pid=5940): Launched 01:03:10.746403 run osmo-stp_10.42.42.5(pid=5937): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5937)] 01:03:10.873379 run osmo-stp_10.42.42.5(pid=5937): stdout: | (launched: 2022-12-10_01:03:09.534398) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:03:11.001440 run osmo-stp_10.42.42.5(pid=5937): stderr: | 20221210010309705 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010309705 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010309705 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010309706 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010309708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010309708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010309708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:03:11.130333 run osmo-stp_10.42.42.5(pid=5937): stdout: | (launched: 2022-12-10_01:03:09.534398) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:03:11.252939 run osmo-stp_10.42.42.5(pid=5937): stderr: | 20221210010309705 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010309705 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010309705 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010309706 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010309708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010309708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010309708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:03:11.398918 run patchelf(pid=5940): Terminating (SIGINT) 01:03:11.565945 run patchelf(pid=5940): Terminated: ok {rc=0} 01:03:11.686055 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5937): Process ended prematurely: osmo-stp_10.42.42.5(pid=5937) [trial-2367↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5937)] [trial-2367↪gprs:trx-b200↪ping.py:22] 01:03:11.694926 tst ping.py:22: Test FAILED (6.4 sec) 01:03:11.722207 run osmo-hlr_10.42.42.2(pid=5934): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5934)] 01:03:11.770023 run osmo-hlr_10.42.42.2(pid=5934): stdout: | (launched: 2022-12-10_01:03:08.589273) 01:03:11.819585 run osmo-hlr_10.42.42.2(pid=5934): stderr: | 20221210010308764 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010308764 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010308764 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010308764 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010308764 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010308764 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010308776 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010308785 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010308785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010308785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:03:11.869672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5933): Terminating (SIGTERM) 01:03:11.909778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5936): Terminating (SIGTERM) 01:03:11.949761 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5939): Terminating (SIGTERM) 01:03:11.989525 --- ParallelTerminationStrategy: PID 5933 died... 01:03:12.008514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5933): Terminated: ok {rc=0} 01:03:12.053027 --- ParallelTerminationStrategy: PID 5936 died... 01:03:12.071592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5936): Terminated: ok {rc=0} 01:03:12.116155 --- ParallelTerminationStrategy: PID 5939 died... 01:03:12.134856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5939): Terminated: ok {rc=0} 01:03:12.220667 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 01:03:13.309277 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:13.320712 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 01:03:13.370638 tst ping_idle_ping.py: using LAC 24903 01:03:13.486634 tst ping_idle_ping.py: using RAC 168 01:03:13.600867 tst ping_idle_ping.py: using CellId 24903 01:03:13.714926 tst ping_idle_ping.py: using BVCI 24904 01:03:13.820053 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:13.830572 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:13.840794 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:13.851492 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:13.862075 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:13.872525 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:13.883203 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:13.893531 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 01:03:14.005892 tst ping_idle_ping.py:24: start network... 01:03:14.201042 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:03:14.655383 run create_hlr_db(pid=5941): Launched 01:03:14.766564 bus /gobi_6: Setting Powered False 01:03:15.831407 run create_hlr_db(pid=5941): Terminated: ok {rc=0} 01:03:16.317788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5943): Launched 01:03:16.659043 run osmo-hlr_10.42.42.2(pid=5944): Launched 01:03:16.906427 run osmo-stp_10.42.42.5: Starting osmo-stp 01:03:17.506574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5946): Launched 01:03:17.822311 run osmo-stp_10.42.42.5(pid=5947): Launched 01:03:17.942627 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:03:18.483641 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5949): Launched 01:03:18.604262 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:03:18.869506 run patchelf(pid=5950): Launched 01:03:19.046074 run osmo-stp_10.42.42.5(pid=5947): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5947)] 01:03:19.179738 run osmo-stp_10.42.42.5(pid=5947): stdout: | (launched: 2022-12-10_01:03:17.765142) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:03:19.315509 run osmo-stp_10.42.42.5(pid=5947): stderr: | 20221210010317955 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010317955 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010317955 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010317956 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010317956 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010317956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010317956 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:03:19.450627 run osmo-stp_10.42.42.5(pid=5947): stdout: | (launched: 2022-12-10_01:03:17.765142) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:03:19.580723 run osmo-stp_10.42.42.5(pid=5947): stderr: | 20221210010317955 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010317955 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010317955 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010317956 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010317956 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010317956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010317956 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:03:19.734857 run patchelf(pid=5950): Terminating (SIGINT) 01:03:19.910980 run patchelf(pid=5950): Terminated: ok {rc=0} 01:03:20.037727 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5947): Process ended prematurely: osmo-stp_10.42.42.5(pid=5947) [trial-2367↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5947)] [trial-2367↪gprs:trx-b200↪ping_idle_ping.py:27] 01:03:20.047073 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 01:03:20.075254 run osmo-hlr_10.42.42.2(pid=5944): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5944)] 01:03:20.125181 run osmo-hlr_10.42.42.2(pid=5944): stdout: | (launched: 2022-12-10_01:03:16.592542) 01:03:20.177247 run osmo-hlr_10.42.42.2(pid=5944): stderr: | 20221210010316820 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010316820 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010316820 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010316820 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010316820 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010316821 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010316836 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010316864 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010316864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010316864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:03:20.229573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5943): Terminating (SIGTERM) 01:03:20.271208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5946): Terminating (SIGTERM) 01:03:20.313154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5949): Terminating (SIGTERM) 01:03:20.355077 --- ParallelTerminationStrategy: PID 5943 died... 01:03:20.375006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5943): Terminated: ok {rc=0} 01:03:20.421252 --- ParallelTerminationStrategy: PID 5946 died... 01:03:20.440708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5946): Terminated: ok {rc=0} 01:03:20.486881 --- ParallelTerminationStrategy: PID 5949 died... 01:03:20.506323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5949): Terminated: ok {rc=0} 01:03:20.594093 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 01:03:21.901754 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:03:21.907391 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 01:03:21.940573 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 01:03:21.979288 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 01:03:22.067098 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 01:03:22.100081 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 01:03:22.138820 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 01:03:22.734439 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 01:03:22.788325 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:22.799520 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:03:22.850698 tst cs_paging_gprs_active.py: using LAC 24904 01:03:22.970747 tst cs_paging_gprs_active.py: using RAC 169 01:03:23.089654 tst cs_paging_gprs_active.py: using CellId 24904 01:03:23.206329 tst cs_paging_gprs_active.py: using BVCI 24905 01:03:23.316129 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:23.326887 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:23.337398 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:23.348286 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:23.358952 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:23.369584 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:23.380285 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:23.390858 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:23.401640 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:03:23.518789 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:03:23.634615 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:03:23.835792 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:03:24.135584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5954): Launched 01:03:24.394687 run iperf3-srv_10.42.42.10(pid=5955): Launched 01:03:24.506747 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:03:24.704884 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:03:25.002909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5956): Launched 01:03:25.261609 run iperf3-srv_10.42.42.10(pid=5957): Launched 01:03:25.373963 tst cs_paging_gprs_active.py:38: start network... 01:03:25.573212 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:03:26.034699 run create_hlr_db(pid=5958): Launched 01:03:26.147834 bus /gobi_6: Setting Powered False 01:03:27.206760 run create_hlr_db(pid=5958): Terminated: ok {rc=0} 01:03:27.640510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5960): Launched 01:03:27.958489 run osmo-hlr_10.42.42.2(pid=5961): Launched 01:03:28.080682 run osmo-stp_10.42.42.5: Starting osmo-stp 01:03:28.634181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5963): Launched 01:03:28.953213 run osmo-stp_10.42.42.5(pid=5964): Launched 01:03:29.076424 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:03:29.627431 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5966): Launched 01:03:29.749703 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:03:30.018544 run patchelf(pid=5967): Launched 01:03:30.196345 run osmo-stp_10.42.42.5(pid=5964): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5964)] 01:03:30.331177 run osmo-stp_10.42.42.5(pid=5964): stdout: | (launched: 2022-12-10_01:03:28.895244) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:03:30.467319 run osmo-stp_10.42.42.5(pid=5964): stderr: | 20221210010329086 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010329087 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010329087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010329087 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010329091 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010329091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010329091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:03:30.603527 run osmo-stp_10.42.42.5(pid=5964): stdout: | (launched: 2022-12-10_01:03:28.895244) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:03:30.734042 run osmo-stp_10.42.42.5(pid=5964): stderr: | 20221210010329086 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010329087 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010329087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010329087 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010329091 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010329091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010329091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:03:30.891270 run patchelf(pid=5967): Terminating (SIGINT) 01:03:31.071903 run patchelf(pid=5967): Terminated: ok {rc=0} 01:03:31.203423 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5964): Process ended prematurely: osmo-stp_10.42.42.5(pid=5964) [trial-2367↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5964)] [trial-2367↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 01:03:31.214484 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 01:03:31.243972 run osmo-hlr_10.42.42.2(pid=5961): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5961)] 01:03:31.294815 run osmo-hlr_10.42.42.2(pid=5961): stdout: | (launched: 2022-12-10_01:03:27.900480) 01:03:31.347425 run osmo-hlr_10.42.42.2(pid=5961): stderr: | 20221210010328099 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010328099 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010328099 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010328099 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010328099 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010328099 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010328112 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010328120 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010328120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010328120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:03:31.401545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5954): Terminating (SIGTERM) 01:03:31.444194 run iperf3-srv_10.42.42.10(pid=5955): Terminating (SIGTERM) 01:03:31.489519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5956): Terminating (SIGTERM) 01:03:31.532194 run iperf3-srv_10.42.42.10(pid=5957): Terminating (SIGTERM) 01:03:31.577268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5960): Terminating (SIGTERM) 01:03:31.620268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5963): Terminating (SIGTERM) 01:03:31.664701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5966): Terminating (SIGTERM) 01:03:31.708341 --- ParallelTerminationStrategy: PID 5954 died... 01:03:31.728318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5954): Terminated: ok {rc=0} 01:03:31.774717 --- ParallelTerminationStrategy: PID 5955 died... 01:03:31.794472 run iperf3-srv_10.42.42.10(pid=5955): Terminated {rc=256} 01:03:31.840599 --- ParallelTerminationStrategy: PID 5956 died... 01:03:31.860331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5956): Terminated: ok {rc=0} 01:03:31.906676 --- ParallelTerminationStrategy: PID 5957 died... 01:03:31.926371 run iperf3-srv_10.42.42.10(pid=5957): Terminated {rc=256} 01:03:31.972574 --- ParallelTerminationStrategy: PID 5960 died... 01:03:31.992362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5960): Terminated: ok {rc=0} 01:03:32.038925 --- ParallelTerminationStrategy: PID 5963 died... 01:03:32.058845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5963): Terminated: ok {rc=0} 01:03:32.104845 --- ParallelTerminationStrategy: PID 5966 died... 01:03:32.124601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5966): Terminated: ok {rc=0} 01:03:32.215077 bus /gobi_0: Setting Powered False 01:03:33.312745 bus /gobi_0: Setting Powered False 01:03:34.427925 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 01:03:35.570927 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:35.582177 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:03:35.636817 tst iperf3.py: using LAC 24905 01:03:35.753388 tst iperf3.py: using RAC 170 01:03:35.869638 tst iperf3.py: using CellId 24905 01:03:35.989641 tst iperf3.py: using BVCI 24906 01:03:36.096547 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:36.107355 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:36.117868 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:36.128482 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:36.139073 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:36.149731 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:36.160488 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:36.171085 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:36.181827 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:03:36.297471 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:03:36.511058 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:03:36.826672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5968): Launched 01:03:37.101633 run iperf3-srv_10.42.42.10(pid=5969): Launched 01:03:37.221375 tst iperf3.py:8: start network... 01:03:37.433590 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:03:37.922939 run create_hlr_db(pid=5970): Launched 01:03:38.052075 bus /gobi_6: Setting Powered False 01:03:39.115678 run create_hlr_db(pid=5970): Terminated: ok {rc=0} 01:03:39.534931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5972): Launched 01:03:39.828012 run osmo-hlr_10.42.42.2(pid=5973): Launched 01:03:39.940486 run osmo-stp_10.42.42.5: Starting osmo-stp 01:03:40.459389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5975): Launched 01:03:40.752494 run osmo-stp_10.42.42.5(pid=5976): Launched 01:03:40.864207 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:03:41.368651 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5978): Launched 01:03:41.481279 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:03:41.728073 run patchelf(pid=5979): Launched 01:03:41.891230 run osmo-stp_10.42.42.5(pid=5976): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5976)] 01:03:42.015245 run osmo-stp_10.42.42.5(pid=5976): stdout: | (launched: 2022-12-10_01:03:40.698606) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:03:42.140814 run osmo-stp_10.42.42.5(pid=5976): stderr: | 20221210010340866 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010340866 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010340866 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010340867 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010340867 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010340867 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010340867 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:03:42.267244 run osmo-stp_10.42.42.5(pid=5976): stdout: | (launched: 2022-12-10_01:03:40.698606) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:03:42.387965 run osmo-stp_10.42.42.5(pid=5976): stderr: | 20221210010340866 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010340866 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010340866 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010340867 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010340867 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010340867 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010340867 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:03:42.530599 run patchelf(pid=5979): Terminating (SIGINT) 01:03:42.694654 run patchelf(pid=5979): Terminated: ok {rc=0} 01:03:42.813289 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5976): Process ended prematurely: osmo-stp_10.42.42.5(pid=5976) [trial-2367↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5976)] [trial-2367↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 01:03:42.822450 tst iperf3.py:8: Test FAILED (7.3 sec) 01:03:42.849378 run osmo-hlr_10.42.42.2(pid=5973): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5973)] 01:03:42.896857 run osmo-hlr_10.42.42.2(pid=5973): stdout: | (launched: 2022-12-10_01:03:39.774316) 01:03:42.945581 run osmo-hlr_10.42.42.2(pid=5973): stderr: | 20221210010339949 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010339949 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010339949 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010339949 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010339949 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010339949 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010339962 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010339970 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010339971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010339971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:03:42.994633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5968): Terminating (SIGTERM) 01:03:43.033747 run iperf3-srv_10.42.42.10(pid=5969): Terminating (SIGTERM) 01:03:43.072699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5972): Terminating (SIGTERM) 01:03:43.111795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5975): Terminating (SIGTERM) 01:03:43.151373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5978): Terminating (SIGTERM) 01:03:43.190698 --- ParallelTerminationStrategy: PID 5968 died... 01:03:43.209347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5968): Terminated: ok {rc=0} 01:03:43.253301 --- ParallelTerminationStrategy: PID 5969 died... 01:03:43.271588 run iperf3-srv_10.42.42.10(pid=5969): Terminated {rc=256} 01:03:43.315564 --- ParallelTerminationStrategy: PID 5972 died... 01:03:43.333775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5972): Terminated: ok {rc=0} 01:03:43.377058 --- ParallelTerminationStrategy: PID 5975 died... 01:03:43.395242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5975): Terminated: ok {rc=0} 01:03:43.438572 --- ParallelTerminationStrategy: PID 5978 died... 01:03:43.456604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5978): Terminated: ok {rc=0} 01:03:43.542654 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 01:03:44.688661 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:44.700143 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:03:44.750406 tst iperf3m4.py: using LAC 24906 01:03:44.867768 tst iperf3m4.py: using RAC 171 01:03:44.982973 tst iperf3m4.py: using CellId 24906 01:03:45.103050 tst iperf3m4.py: using BVCI 24907 01:03:45.210617 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:45.221328 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:45.231881 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:45.242664 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:45.252898 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:45.263743 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:45.274623 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:45.285405 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:45.296327 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:03:45.409990 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:03:45.528259 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:03:45.644159 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:03:45.761357 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:03:45.977798 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:03:46.306126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5980): Launched 01:03:46.606018 run iperf3-srv_10.42.42.10(pid=5981): Launched 01:03:46.733155 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:03:46.950283 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:03:47.265457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5982): Launched 01:03:47.523733 run iperf3-srv_10.42.42.10(pid=5983): Launched 01:03:47.635478 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:03:47.832045 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:03:48.126311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5984): Launched 01:03:48.381671 run iperf3-srv_10.42.42.10(pid=5985): Launched 01:03:48.493227 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:03:48.690595 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:03:48.985920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5986): Launched 01:03:49.242244 run iperf3-srv_10.42.42.10(pid=5987): Launched 01:03:49.352470 tst iperf3m4.py:8: start network... 01:03:49.547819 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:03:50.001213 run create_hlr_db(pid=5988): Launched 01:03:50.114313 bus /gobi_6: Setting Powered False 01:03:51.173711 run create_hlr_db(pid=5988): Terminated: ok {rc=0} 01:03:51.583765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5990): Launched 01:03:51.877238 run osmo-hlr_10.42.42.2(pid=5991): Launched 01:03:51.990310 run osmo-stp_10.42.42.5: Starting osmo-stp 01:03:52.510893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5993): Launched 01:03:52.804406 run osmo-stp_10.42.42.5(pid=5994): Launched 01:03:52.916612 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:03:53.422790 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5996): Launched 01:03:53.535303 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:03:53.783024 run patchelf(pid=5997): Launched 01:03:53.946263 run osmo-stp_10.42.42.5(pid=5994): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5994)] 01:03:54.070699 run osmo-stp_10.42.42.5(pid=5994): stdout: | (launched: 2022-12-10_01:03:52.750256) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:03:54.196901 run osmo-stp_10.42.42.5(pid=5994): stderr: | 20221210010352916 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010352916 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010352916 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010352917 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010352917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010352917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010352917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:03:54.323076 run osmo-stp_10.42.42.5(pid=5994): stdout: | (launched: 2022-12-10_01:03:52.750256) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:03:54.443726 run osmo-stp_10.42.42.5(pid=5994): stderr: | 20221210010352916 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010352916 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010352916 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010352917 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010352917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010352917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010352917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:03:54.586656 run patchelf(pid=5997): Terminating (SIGINT) 01:03:54.751590 run patchelf(pid=5997): Terminated: ok {rc=0} 01:03:54.870682 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5994): Process ended prematurely: osmo-stp_10.42.42.5(pid=5994) [trial-2367↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5994)] [trial-2367↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 01:03:54.879813 tst iperf3m4.py:8: Test FAILED (10.2 sec) 01:03:54.907228 run osmo-hlr_10.42.42.2(pid=5991): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5991)] 01:03:54.955044 run osmo-hlr_10.42.42.2(pid=5991): stdout: | (launched: 2022-12-10_01:03:51.823628) 01:03:55.004181 run osmo-hlr_10.42.42.2(pid=5991): stderr: | 20221210010351998 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010351998 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010351998 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010351998 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010351998 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010351998 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010352010 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010352019 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010352019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010352019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:03:55.053630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5980): Terminating (SIGTERM) 01:03:55.093250 run iperf3-srv_10.42.42.10(pid=5981): Terminating (SIGTERM) 01:03:55.133028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5982): Terminating (SIGTERM) 01:03:55.172412 run iperf3-srv_10.42.42.10(pid=5983): Terminating (SIGTERM) 01:03:55.212201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5984): Terminating (SIGTERM) 01:03:55.251914 run iperf3-srv_10.42.42.10(pid=5985): Terminating (SIGTERM) 01:03:55.291323 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5986): Terminating (SIGTERM) 01:03:55.330695 run iperf3-srv_10.42.42.10(pid=5987): Terminating (SIGTERM) 01:03:55.370081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5990): Terminating (SIGTERM) 01:03:55.409535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5993): Terminating (SIGTERM) 01:03:55.448992 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5996): Terminating (SIGTERM) 01:03:55.488636 --- ParallelTerminationStrategy: PID 5980 died... 01:03:55.507566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5980): Terminated: ok {rc=0} 01:03:55.551538 --- ParallelTerminationStrategy: PID 5981 died... 01:03:55.569809 run iperf3-srv_10.42.42.10(pid=5981): Terminated {rc=256} 01:03:55.613752 --- ParallelTerminationStrategy: PID 5982 died... 01:03:55.631753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5982): Terminated: ok {rc=0} 01:03:55.674709 --- ParallelTerminationStrategy: PID 5983 died... 01:03:55.692746 run iperf3-srv_10.42.42.10(pid=5983): Terminated {rc=256} 01:03:55.735879 --- ParallelTerminationStrategy: PID 5984 died... 01:03:55.754077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5984): Terminated: ok {rc=0} 01:03:55.797608 --- ParallelTerminationStrategy: PID 5985 died... 01:03:55.815609 run iperf3-srv_10.42.42.10(pid=5985): Terminated {rc=256} 01:03:55.858640 --- ParallelTerminationStrategy: PID 5986 died... 01:03:55.876694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5986): Terminated: ok {rc=0} 01:03:55.919847 --- ParallelTerminationStrategy: PID 5987 died... 01:03:55.937956 run iperf3-srv_10.42.42.10(pid=5987): Terminated {rc=256} 01:03:55.981409 --- ParallelTerminationStrategy: PID 5990 died... 01:03:55.999604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5990): Terminated: ok {rc=0} 01:03:56.043351 --- ParallelTerminationStrategy: PID 5993 died... 01:03:56.061578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5993): Terminated: ok {rc=0} 01:03:56.105408 --- ParallelTerminationStrategy: PID 5996 died... 01:03:56.123700 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5996): Terminated: ok {rc=0} 01:03:56.207811 bus /gobi_4: Setting Powered False 01:03:57.305668 bus /gobi_4: Setting Powered False 01:03:58.419136 bus /gobi_1: Setting Powered False 01:03:59.518848 bus /gobi_1: Setting Powered False 01:04:00.632556 bus /gobi_0: Setting Powered False 01:04:01.732452 bus /gobi_0: Setting Powered False 01:04:02.846312 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 01:04:03.944311 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:03.955481 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:04:04.005424 tst ping.py: using LAC 24907 01:04:04.130220 tst ping.py: using RAC 172 01:04:04.251260 tst ping.py: using CellId 24907 01:04:04.371677 tst ping.py: using BVCI 24908 01:04:04.483843 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:04.495128 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:04.506289 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:04.517549 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:04.528477 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:04.539471 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:04.550901 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:04.561813 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:04:04.674517 tst ping.py:19: start network... 01:04:04.867740 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:04:05.316143 run create_hlr_db(pid=5998): Launched 01:04:05.428093 bus /gobi_6: Setting Powered False 01:04:06.486661 run create_hlr_db(pid=5998): Terminated: ok {rc=0} 01:04:06.910848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6000): Launched 01:04:07.221908 run osmo-hlr_10.42.42.2(pid=6001): Launched 01:04:07.341088 run osmo-stp_10.42.42.5: Starting osmo-stp 01:04:07.882289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6003): Launched 01:04:08.191515 run osmo-stp_10.42.42.5(pid=6004): Launched 01:04:08.309450 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:04:08.845957 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6006): Launched 01:04:08.964316 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:04:09.226031 run patchelf(pid=6007): Launched 01:04:09.399362 run osmo-stp_10.42.42.5(pid=6004): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6004)] 01:04:09.530600 run osmo-stp_10.42.42.5(pid=6004): stdout: | (launched: 2022-12-10_01:04:08.134917) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:04:09.663288 run osmo-stp_10.42.42.5(pid=6004): stderr: | 20221210010408327 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010408327 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010408327 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010408328 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010408328 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010408328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010408328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:04:09.796173 run osmo-stp_10.42.42.5(pid=6004): stdout: | (launched: 2022-12-10_01:04:08.134917) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:04:09.923933 run osmo-stp_10.42.42.5(pid=6004): stderr: | 20221210010408327 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010408327 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010408327 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010408328 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010408328 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010408328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010408328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:04:10.075165 run patchelf(pid=6007): Terminating (SIGINT) 01:04:10.248784 run patchelf(pid=6007): Terminated: ok {rc=0} 01:04:10.373829 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6004): Process ended prematurely: osmo-stp_10.42.42.5(pid=6004) [trial-2367↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6004)] [trial-2367↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 01:04:10.383279 tst ping.py:22: Test FAILED (6.4 sec) 01:04:10.411045 run osmo-hlr_10.42.42.2(pid=6001): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6001)] 01:04:10.460369 run osmo-hlr_10.42.42.2(pid=6001): stdout: | (launched: 2022-12-10_01:04:07.165285) 01:04:10.511802 run osmo-hlr_10.42.42.2(pid=6001): stderr: | 20221210010407361 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010407362 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010407362 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010407362 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010407362 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010407362 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010407374 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010407383 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010407383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010407383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:04:10.563523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6000): Terminating (SIGTERM) 01:04:10.604725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6003): Terminating (SIGTERM) 01:04:10.646101 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6006): Terminating (SIGTERM) 01:04:10.687626 --- ParallelTerminationStrategy: PID 6000 died... 01:04:10.707269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6000): Terminated: ok {rc=0} 01:04:10.752912 --- ParallelTerminationStrategy: PID 6003 died... 01:04:10.772588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6003): Terminated: ok {rc=0} 01:04:10.818137 --- ParallelTerminationStrategy: PID 6006 died... 01:04:10.837436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6006): Terminated: ok {rc=0} 01:04:10.923613 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 01:04:12.009820 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:12.021665 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:04:12.074329 tst ping_idle_ping.py: using LAC 24908 01:04:12.189570 tst ping_idle_ping.py: using RAC 173 01:04:12.319184 tst ping_idle_ping.py: using CellId 24908 01:04:12.449443 tst ping_idle_ping.py: using BVCI 24909 01:04:12.563465 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:12.574735 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:12.585830 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:12.596819 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:12.607773 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:12.618745 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:12.629929 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:12.640909 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:04:12.754127 tst ping_idle_ping.py:24: start network... 01:04:12.947537 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:04:13.398051 run create_hlr_db(pid=6008): Launched 01:04:13.509830 bus /gobi_6: Setting Powered False 01:04:14.568492 run create_hlr_db(pid=6008): Terminated: ok {rc=0} 01:04:14.995209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6010): Launched 01:04:15.308829 run osmo-hlr_10.42.42.2(pid=6011): Launched 01:04:15.428938 run osmo-stp_10.42.42.5: Starting osmo-stp 01:04:16.003256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6013): Launched 01:04:16.319474 run osmo-stp_10.42.42.5(pid=6014): Launched 01:04:16.569877 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:04:17.296606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6016): Launched 01:04:17.416025 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:04:17.678935 run patchelf(pid=6017): Launched 01:04:17.851811 run osmo-stp_10.42.42.5(pid=6014): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6014)] 01:04:17.983347 run osmo-stp_10.42.42.5(pid=6014): stdout: | (launched: 2022-12-10_01:04:16.256034) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:04:18.116582 run osmo-stp_10.42.42.5(pid=6014): stderr: | 20221210010416672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010416672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010416674 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010416677 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010416679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010416680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010416680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:04:18.250427 run osmo-stp_10.42.42.5(pid=6014): stdout: | (launched: 2022-12-10_01:04:16.256034) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:04:18.378407 run osmo-stp_10.42.42.5(pid=6014): stderr: | 20221210010416672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010416672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010416674 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010416677 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010416679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010416680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010416680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:04:18.529847 run patchelf(pid=6017): Terminating (SIGINT) 01:04:18.703324 run patchelf(pid=6017): Terminated: ok {rc=0} 01:04:18.828221 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6014): Process ended prematurely: osmo-stp_10.42.42.5(pid=6014) [trial-2367↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6014)] [trial-2367↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 01:04:18.837577 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 01:04:18.864990 run osmo-hlr_10.42.42.2(pid=6011): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6011)] 01:04:18.913856 run osmo-hlr_10.42.42.2(pid=6011): stdout: | (launched: 2022-12-10_01:04:15.251447) 01:04:18.964463 run osmo-hlr_10.42.42.2(pid=6011): stderr: | 20221210010415447 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010415447 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010415447 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010415448 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010415448 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010415448 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010415460 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010415468 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010415468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010415468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:04:19.015635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6010): Terminating (SIGTERM) 01:04:19.056424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6013): Terminating (SIGTERM) 01:04:19.097332 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6016): Terminating (SIGTERM) 01:04:19.138442 --- ParallelTerminationStrategy: PID 6010 died... 01:04:19.157998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6010): Terminated: ok {rc=0} 01:04:19.203471 --- ParallelTerminationStrategy: PID 6013 died... 01:04:19.222807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6013): Terminated: ok {rc=0} 01:04:19.267982 --- ParallelTerminationStrategy: PID 6016 died... 01:04:19.287138 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6016): Terminated: ok {rc=0} 01:04:19.373666 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 01:04:20.680581 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:04:20.687257 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 01:04:20.720792 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 01:04:20.759227 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 01:04:20.846876 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 01:04:20.880038 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 01:04:20.918471 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 01:04:21.508583 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 01:04:21.557256 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:21.568106 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:04:21.636737 tst cs_paging_gprs_active.py: using LAC 24909 01:04:21.753151 tst cs_paging_gprs_active.py: using RAC 174 01:04:21.869658 tst cs_paging_gprs_active.py: using CellId 24909 01:04:21.995200 tst cs_paging_gprs_active.py: using BVCI 24910 01:04:22.111327 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:22.122442 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:22.133422 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:22.144277 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:22.155111 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:22.166422 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:22.177492 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:22.188662 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:22.199676 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:04:22.314200 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:04:22.430324 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:04:22.629142 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:04:22.926420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6021): Launched 01:04:23.185366 run iperf3-srv_10.42.42.10(pid=6022): Launched 01:04:23.297516 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:04:23.496238 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:04:23.793881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6023): Launched 01:04:24.054065 run iperf3-srv_10.42.42.10(pid=6024): Launched 01:04:24.166562 tst cs_paging_gprs_active.py:38: start network... 01:04:24.365300 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:04:24.825257 run create_hlr_db(pid=6025): Launched 01:04:24.940135 bus /gobi_6: Setting Powered False 01:04:26.000217 run create_hlr_db(pid=6025): Terminated: ok {rc=0} 01:04:26.433673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6027): Launched 01:04:26.755276 run osmo-hlr_10.42.42.2(pid=6028): Launched 01:04:26.878199 run osmo-stp_10.42.42.5: Starting osmo-stp 01:04:27.426324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6030): Launched 01:04:27.745744 run osmo-stp_10.42.42.5(pid=6031): Launched 01:04:27.868713 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:04:28.421753 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6033): Launched 01:04:28.544581 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:04:28.814370 run patchelf(pid=6034): Launched 01:04:28.992182 run osmo-stp_10.42.42.5(pid=6031): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6031)] 01:04:29.127072 run osmo-stp_10.42.42.5(pid=6031): stdout: | (launched: 2022-12-10_01:04:27.687863) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:04:29.264075 run osmo-stp_10.42.42.5(pid=6031): stderr: | 20221210010427878 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010427878 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010427878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010427879 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010427879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010427879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010427879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:04:29.400313 run osmo-stp_10.42.42.5(pid=6031): stdout: | (launched: 2022-12-10_01:04:27.687863) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:04:29.531567 run osmo-stp_10.42.42.5(pid=6031): stderr: | 20221210010427878 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010427878 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010427878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010427879 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010427879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010427879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010427879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:04:29.686861 run patchelf(pid=6034): Terminating (SIGINT) 01:04:29.864461 run patchelf(pid=6034): Terminated: ok {rc=0} 01:04:29.993018 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6031): Process ended prematurely: osmo-stp_10.42.42.5(pid=6031) [trial-2367↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6031)] [trial-2367↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 01:04:30.003010 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 01:04:30.031362 run osmo-hlr_10.42.42.2(pid=6028): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6028)] 01:04:30.080792 run osmo-hlr_10.42.42.2(pid=6028): stdout: | (launched: 2022-12-10_01:04:26.697345) 01:04:30.132286 run osmo-hlr_10.42.42.2(pid=6028): stderr: | 20221210010426894 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010426894 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010426896 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010426896 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010426896 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010426896 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010426911 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010426921 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010426921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010426921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:04:30.184175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6021): Terminating (SIGTERM) 01:04:30.225995 run iperf3-srv_10.42.42.10(pid=6022): Terminating (SIGTERM) 01:04:30.267366 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6023): Terminating (SIGTERM) 01:04:30.308647 run iperf3-srv_10.42.42.10(pid=6024): Terminating (SIGTERM) 01:04:30.349944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6027): Terminating (SIGTERM) 01:04:30.391317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6030): Terminating (SIGTERM) 01:04:30.432682 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6033): Terminating (SIGTERM) 01:04:30.474377 --- ParallelTerminationStrategy: PID 6021 died... 01:04:30.494217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6021): Terminated: ok {rc=0} 01:04:30.540284 --- ParallelTerminationStrategy: PID 6022 died... 01:04:30.559637 run iperf3-srv_10.42.42.10(pid=6022): Terminated {rc=256} 01:04:30.605099 --- ParallelTerminationStrategy: PID 6023 died... 01:04:30.624457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6023): Terminated: ok {rc=0} 01:04:30.669828 --- ParallelTerminationStrategy: PID 6024 died... 01:04:30.688869 run iperf3-srv_10.42.42.10(pid=6024): Terminated {rc=256} 01:04:30.734054 --- ParallelTerminationStrategy: PID 6027 died... 01:04:30.753484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6027): Terminated: ok {rc=0} 01:04:30.799336 --- ParallelTerminationStrategy: PID 6030 died... 01:04:30.818830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6030): Terminated: ok {rc=0} 01:04:30.864792 --- ParallelTerminationStrategy: PID 6033 died... 01:04:30.884690 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6033): Terminated: ok {rc=0} 01:04:30.991091 bus /gobi_0: Setting Powered False 01:04:32.104466 bus /gobi_0: Setting Powered False 01:04:33.234526 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 01:04:34.379212 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:34.390688 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:04:34.462319 tst iperf3.py: using LAC 24910 01:04:34.579961 tst iperf3.py: using RAC 175 01:04:34.697404 tst iperf3.py: using CellId 24910 01:04:34.812824 tst iperf3.py: using BVCI 24911 01:04:34.919778 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:34.930600 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:34.941200 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:34.951702 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:34.963121 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:34.973775 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:34.984262 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:34.995310 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:35.006226 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:04:35.120538 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:04:35.319117 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:04:35.616302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6035): Launched 01:04:35.875504 run iperf3-srv_10.42.42.10(pid=6036): Launched 01:04:35.987318 tst iperf3.py:8: start network... 01:04:36.185067 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:04:36.643884 run create_hlr_db(pid=6037): Launched 01:04:36.757570 bus /gobi_6: Setting Powered False 01:04:37.816765 run create_hlr_db(pid=6037): Terminated: ok {rc=0} 01:04:38.250272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6039): Launched 01:04:38.568112 run osmo-hlr_10.42.42.2(pid=6040): Launched 01:04:38.690468 run osmo-stp_10.42.42.5: Starting osmo-stp 01:04:39.238073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6042): Launched 01:04:39.556622 run osmo-stp_10.42.42.5(pid=6043): Launched 01:04:39.680035 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:04:40.229913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6045): Launched 01:04:40.353409 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:04:40.623621 run patchelf(pid=6047): Launched 01:04:40.801683 run osmo-stp_10.42.42.5(pid=6043): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6043)] 01:04:40.937091 run osmo-stp_10.42.42.5(pid=6043): stdout: | (launched: 2022-12-10_01:04:39.498972) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:04:41.073545 run osmo-stp_10.42.42.5(pid=6043): stderr: | 20221210010439692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010439692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010439692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010439693 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010439693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010439693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010439693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:04:41.210921 run osmo-stp_10.42.42.5(pid=6043): stdout: | (launched: 2022-12-10_01:04:39.498972) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:04:41.341802 run osmo-stp_10.42.42.5(pid=6043): stderr: | 20221210010439692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010439692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010439692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010439693 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010439693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010439693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010439693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:04:41.497165 run patchelf(pid=6047): Terminating (SIGINT) 01:04:41.675565 run patchelf(pid=6047): Terminated: ok {rc=0} 01:04:41.803989 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6043): Process ended prematurely: osmo-stp_10.42.42.5(pid=6043) [trial-2367↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6043)] [trial-2367↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 01:04:41.814086 tst iperf3.py:8: Test FAILED (7.5 sec) 01:04:41.842729 run osmo-hlr_10.42.42.2(pid=6040): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6040)] 01:04:41.893194 run osmo-hlr_10.42.42.2(pid=6040): stdout: | (launched: 2022-12-10_01:04:38.510587) 01:04:41.945164 run osmo-hlr_10.42.42.2(pid=6040): stderr: | 20221210010438707 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010438707 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010438707 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010438707 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010438707 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010438707 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010438720 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010438728 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010438728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010438728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:04:41.997716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6035): Terminating (SIGTERM) 01:04:42.039828 run iperf3-srv_10.42.42.10(pid=6036): Terminating (SIGTERM) 01:04:42.081851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6039): Terminating (SIGTERM) 01:04:42.123975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6042): Terminating (SIGTERM) 01:04:42.166218 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6045): Terminating (SIGTERM) 01:04:42.208747 --- ParallelTerminationStrategy: PID 6035 died... 01:04:42.228924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6035): Terminated: ok {rc=0} 01:04:42.275155 --- ParallelTerminationStrategy: PID 6036 died... 01:04:42.294828 run iperf3-srv_10.42.42.10(pid=6036): Terminated {rc=256} 01:04:42.340646 --- ParallelTerminationStrategy: PID 6039 died... 01:04:42.360160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6039): Terminated: ok {rc=0} 01:04:42.405983 --- ParallelTerminationStrategy: PID 6042 died... 01:04:42.425504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6042): Terminated: ok {rc=0} 01:04:42.471236 --- ParallelTerminationStrategy: PID 6045 died... 01:04:42.490864 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6045): Terminated: ok {rc=0} 01:04:42.577548 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 01:04:43.725738 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:43.737386 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:04:43.804772 tst iperf3m4.py: using LAC 24911 01:04:43.920280 tst iperf3m4.py: using RAC 176 01:04:44.035338 tst iperf3m4.py: using CellId 24911 01:04:44.150489 tst iperf3m4.py: using BVCI 24912 01:04:44.258297 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:44.269203 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:44.279600 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:44.290865 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:44.302140 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:44.313580 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:44.324997 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:44.335508 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:44.346178 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:04:44.466603 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:04:44.584590 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:04:44.704595 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:04:44.824750 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:04:45.039830 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:04:45.360386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6048): Launched 01:04:45.639839 run iperf3-srv_10.42.42.10(pid=6049): Launched 01:04:45.761402 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:04:45.995577 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:04:46.351221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6050): Launched 01:04:46.655208 run iperf3-srv_10.42.42.10(pid=6051): Launched 01:04:46.779188 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:04:46.985535 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:04:47.291273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6052): Launched 01:04:47.553266 run iperf3-srv_10.42.42.10(pid=6053): Launched 01:04:47.666701 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:04:47.865156 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:04:48.163520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6054): Launched 01:04:48.424093 run iperf3-srv_10.42.42.10(pid=6055): Launched 01:04:48.537553 tst iperf3m4.py:8: start network... 01:04:48.736202 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:04:49.197748 run create_hlr_db(pid=6056): Launched 01:04:49.312485 bus /gobi_6: Setting Powered False 01:04:50.371062 run create_hlr_db(pid=6056): Terminated: ok {rc=0} 01:04:50.807160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6058): Launched 01:04:51.126218 run osmo-hlr_10.42.42.2(pid=6059): Launched 01:04:51.248906 run osmo-stp_10.42.42.5: Starting osmo-stp 01:04:51.805602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6062): Launched 01:04:52.126660 run osmo-stp_10.42.42.5(pid=6063): Launched 01:04:52.250367 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:04:52.800237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6065): Launched 01:04:52.922747 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:04:53.192377 run patchelf(pid=6066): Launched 01:04:53.372540 run osmo-stp_10.42.42.5(pid=6063): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6063)] 01:04:53.507403 run osmo-stp_10.42.42.5(pid=6063): stdout: | (launched: 2022-12-10_01:04:52.068046) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:04:53.643872 run osmo-stp_10.42.42.5(pid=6063): stderr: | 20221210010452256 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010452256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010452257 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010452257 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010452257 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010452258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010452258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:04:53.780526 run osmo-stp_10.42.42.5(pid=6063): stdout: | (launched: 2022-12-10_01:04:52.068046) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:04:53.911688 run osmo-stp_10.42.42.5(pid=6063): stderr: | 20221210010452256 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010452256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010452257 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010452257 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010452257 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010452258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010452258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:04:54.067463 run patchelf(pid=6066): Terminating (SIGINT) 01:04:54.246872 run patchelf(pid=6066): Terminated: ok {rc=0} 01:04:54.375475 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6063): Process ended prematurely: osmo-stp_10.42.42.5(pid=6063) [trial-2367↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6063)] [trial-2367↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 01:04:54.385376 tst iperf3m4.py:8: Test FAILED (10.7 sec) 01:04:54.414059 run osmo-hlr_10.42.42.2(pid=6059): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6059)] 01:04:54.463769 run osmo-hlr_10.42.42.2(pid=6059): stdout: | (launched: 2022-12-10_01:04:51.068232) 01:04:54.515268 run osmo-hlr_10.42.42.2(pid=6059): stderr: | 20221210010451262 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010451262 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010451262 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010451262 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010451262 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010451262 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010451276 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010451284 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010451284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010451284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:04:54.567331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6048): Terminating (SIGTERM) 01:04:54.609357 run iperf3-srv_10.42.42.10(pid=6049): Terminating (SIGTERM) 01:04:54.651172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6050): Terminating (SIGTERM) 01:04:54.692934 run iperf3-srv_10.42.42.10(pid=6051): Terminating (SIGTERM) 01:04:54.734629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6052): Terminating (SIGTERM) 01:04:54.776362 run iperf3-srv_10.42.42.10(pid=6053): Terminating (SIGTERM) 01:04:54.818051 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6054): Terminating (SIGTERM) 01:04:54.859892 run iperf3-srv_10.42.42.10(pid=6055): Terminating (SIGTERM) 01:04:54.901579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6058): Terminating (SIGTERM) 01:04:54.943357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6062): Terminating (SIGTERM) 01:04:54.985155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6065): Terminating (SIGTERM) 01:04:55.027166 --- ParallelTerminationStrategy: PID 6048 died... 01:04:55.047282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6048): Terminated: ok {rc=0} 01:04:55.093709 --- ParallelTerminationStrategy: PID 6049 died... 01:04:55.113295 run iperf3-srv_10.42.42.10(pid=6049): Terminated {rc=256} 01:04:55.159059 --- ParallelTerminationStrategy: PID 6050 died... 01:04:55.178886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6050): Terminated: ok {rc=0} 01:04:55.224604 --- ParallelTerminationStrategy: PID 6051 died... 01:04:55.244191 run iperf3-srv_10.42.42.10(pid=6051): Terminated {rc=256} 01:04:55.289993 --- ParallelTerminationStrategy: PID 6052 died... 01:04:55.309717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6052): Terminated: ok {rc=0} 01:04:55.355596 --- ParallelTerminationStrategy: PID 6053 died... 01:04:55.375116 run iperf3-srv_10.42.42.10(pid=6053): Terminated {rc=256} 01:04:55.420749 --- ParallelTerminationStrategy: PID 6054 died... 01:04:55.440338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6054): Terminated: ok {rc=0} 01:04:55.486274 --- ParallelTerminationStrategy: PID 6055 died... 01:04:55.505684 run iperf3-srv_10.42.42.10(pid=6055): Terminated {rc=256} 01:04:55.551397 --- ParallelTerminationStrategy: PID 6058 died... 01:04:55.570970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6058): Terminated: ok {rc=0} 01:04:55.616764 --- ParallelTerminationStrategy: PID 6062 died... 01:04:55.636505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6062): Terminated: ok {rc=0} 01:04:55.682322 --- ParallelTerminationStrategy: PID 6065 died... 01:04:55.702034 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6065): Terminated: ok {rc=0} 01:04:55.789529 bus /gobi_4: Setting Powered False 01:04:56.887940 bus /gobi_4: Setting Powered False 01:04:58.005510 bus /gobi_1: Setting Powered False 01:04:59.103027 bus /gobi_1: Setting Powered False 01:05:00.218436 bus /gobi_0: Setting Powered False 01:05:01.314469 bus /gobi_0: Setting Powered False 01:05:02.431277 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 01:05:03.534046 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:03.546072 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:05:03.618288 tst ping.py: using LAC 24912 01:05:03.743529 tst ping.py: using RAC 177 01:05:03.867038 tst ping.py: using CellId 24912 01:05:03.989198 tst ping.py: using BVCI 24913 01:05:04.102493 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:04.113878 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:04.124848 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:04.135950 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:04.146942 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:04.158000 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:04.169263 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:04.180266 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:05:04.296848 tst ping.py:19: start network... 01:05:04.506892 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:05:04.991545 run create_hlr_db(pid=6070): Launched 01:05:05.119615 bus /gobi_6: Setting Powered False 01:05:06.183001 run create_hlr_db(pid=6070): Terminated: ok {rc=0} 01:05:06.601205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6072): Launched 01:05:06.893584 run osmo-hlr_10.42.42.2(pid=6073): Launched 01:05:07.006352 run osmo-stp_10.42.42.5: Starting osmo-stp 01:05:07.523570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6075): Launched 01:05:07.815149 run osmo-stp_10.42.42.5(pid=6076): Launched 01:05:07.927577 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:05:08.431758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6078): Launched 01:05:08.545353 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:05:08.792010 run patchelf(pid=6079): Launched 01:05:08.956441 run osmo-stp_10.42.42.5(pid=6076): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6076)] 01:05:09.080047 run osmo-stp_10.42.42.5(pid=6076): stdout: | (launched: 2022-12-10_01:05:07.761588) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:05:09.205513 run osmo-stp_10.42.42.5(pid=6076): stderr: | 20221210010507931 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010507931 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010507931 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010507932 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010507932 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010507932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010507932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:05:09.330738 run osmo-stp_10.42.42.5(pid=6076): stdout: | (launched: 2022-12-10_01:05:07.761588) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:05:09.451266 run osmo-stp_10.42.42.5(pid=6076): stderr: | 20221210010507931 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010507931 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010507931 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010507932 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010507932 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010507932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010507932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:05:09.593858 run patchelf(pid=6079): Terminating (SIGINT) 01:05:09.757844 run patchelf(pid=6079): Terminated: ok {rc=0} 01:05:09.876595 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6076): Process ended prematurely: osmo-stp_10.42.42.5(pid=6076) [trial-2367↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6076)] [trial-2367↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 01:05:09.885536 tst ping.py:22: Test FAILED (6.3 sec) 01:05:09.912813 run osmo-hlr_10.42.42.2(pid=6073): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6073)] 01:05:09.960911 run osmo-hlr_10.42.42.2(pid=6073): stdout: | (launched: 2022-12-10_01:05:06.839701) 01:05:10.010541 run osmo-hlr_10.42.42.2(pid=6073): stderr: | 20221210010507014 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010507014 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010507014 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010507014 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010507014 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010507014 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010507026 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010507035 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010507035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010507035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:05:10.060475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6072): Terminating (SIGTERM) 01:05:10.100636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6075): Terminating (SIGTERM) 01:05:10.141003 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6078): Terminating (SIGTERM) 01:05:10.181336 --- ParallelTerminationStrategy: PID 6072 died... 01:05:10.200396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6072): Terminated: ok {rc=0} 01:05:10.244705 --- ParallelTerminationStrategy: PID 6075 died... 01:05:10.263500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6075): Terminated: ok {rc=0} 01:05:10.307204 --- ParallelTerminationStrategy: PID 6078 died... 01:05:10.326183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6078): Terminated: ok {rc=0} 01:05:10.412329 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 01:05:11.501458 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:11.513019 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:05:11.582897 tst ping_idle_ping.py: using LAC 24913 01:05:11.697762 tst ping_idle_ping.py: using RAC 178 01:05:11.812246 tst ping_idle_ping.py: using CellId 24913 01:05:11.927343 tst ping_idle_ping.py: using BVCI 24914 01:05:12.033760 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:12.044611 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:12.055224 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:12.066169 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:12.077011 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:12.087802 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:12.098778 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:12.109604 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:05:12.226210 tst ping_idle_ping.py:24: start network... 01:05:12.438946 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:05:12.934096 run create_hlr_db(pid=6080): Launched 01:05:13.063905 bus /gobi_6: Setting Powered False 01:05:14.125620 run create_hlr_db(pid=6080): Terminated: ok {rc=0} 01:05:14.543713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6082): Launched 01:05:14.838198 run osmo-hlr_10.42.42.2(pid=6083): Launched 01:05:14.950994 run osmo-stp_10.42.42.5: Starting osmo-stp 01:05:15.492155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6085): Launched 01:05:15.805955 run osmo-stp_10.42.42.5(pid=6086): Launched 01:05:16.065232 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:05:16.750565 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6088): Launched 01:05:16.878813 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:05:17.141536 run patchelf(pid=6089): Launched 01:05:17.322261 run osmo-stp_10.42.42.5(pid=6086): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6086)] 01:05:17.446364 run osmo-stp_10.42.42.5(pid=6086): stdout: | (launched: 2022-12-10_01:05:15.748916) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:05:17.572141 run osmo-stp_10.42.42.5(pid=6086): stderr: | 20221210010516025 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010516025 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010516026 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010516026 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010516026 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010516026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010516027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:05:17.698813 run osmo-stp_10.42.42.5(pid=6086): stdout: | (launched: 2022-12-10_01:05:15.748916) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:05:17.819228 run osmo-stp_10.42.42.5(pid=6086): stderr: | 20221210010516025 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010516025 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010516026 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010516026 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010516026 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010516026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010516027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:05:17.961942 run patchelf(pid=6089): Terminating (SIGINT) 01:05:18.125839 run patchelf(pid=6089): Terminated: ok {rc=0} 01:05:18.244181 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6086): Process ended prematurely: osmo-stp_10.42.42.5(pid=6086) [trial-2367↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6086)] [trial-2367↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 01:05:18.252835 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 01:05:18.279631 run osmo-hlr_10.42.42.2(pid=6083): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6083)] 01:05:18.327490 run osmo-hlr_10.42.42.2(pid=6083): stdout: | (launched: 2022-12-10_01:05:14.784262) 01:05:18.376402 run osmo-hlr_10.42.42.2(pid=6083): stderr: | 20221210010514959 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010514959 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010514959 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010514959 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010514959 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010514959 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010514971 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010514980 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010514981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010514981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:05:18.425963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6082): Terminating (SIGTERM) 01:05:18.465287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6085): Terminating (SIGTERM) 01:05:18.505088 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6088): Terminating (SIGTERM) 01:05:18.545325 --- ParallelTerminationStrategy: PID 6082 died... 01:05:18.563967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6082): Terminated: ok {rc=0} 01:05:18.607556 --- ParallelTerminationStrategy: PID 6085 died... 01:05:18.626025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6085): Terminated: ok {rc=0} 01:05:18.669392 --- ParallelTerminationStrategy: PID 6088 died... 01:05:18.687747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6088): Terminated: ok {rc=0} 01:05:18.773244 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 01:05:20.076381 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:05:20.082702 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 01:05:20.116165 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 01:05:20.153803 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 01:05:20.237490 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 01:05:20.269710 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 01:05:20.307646 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 01:05:20.901928 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 01:05:20.951096 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:20.962107 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:05:21.033692 tst cs_paging_gprs_active.py: using LAC 24914 01:05:21.149944 tst cs_paging_gprs_active.py: using RAC 179 01:05:21.267359 tst cs_paging_gprs_active.py: using CellId 24914 01:05:21.382639 tst cs_paging_gprs_active.py: using BVCI 24915 01:05:21.491955 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:21.502832 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:21.513364 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:21.524274 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:21.535242 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:21.546400 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:21.557435 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:21.568787 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:21.579855 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:05:21.699013 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:05:21.817995 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:05:22.034206 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:05:22.354186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6093): Launched 01:05:22.633112 run iperf3-srv_10.42.42.10(pid=6095): Launched 01:05:22.753850 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:05:22.968717 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:05:23.289776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6096): Launched 01:05:23.569626 run iperf3-srv_10.42.42.10(pid=6097): Launched 01:05:23.690148 tst cs_paging_gprs_active.py:38: start network... 01:05:23.905839 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:05:24.404686 run create_hlr_db(pid=6098): Launched 01:05:24.535578 bus /gobi_6: Setting Powered False 01:05:25.598517 run create_hlr_db(pid=6098): Terminated: ok {rc=0} 01:05:26.042124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6100): Launched 01:05:26.361677 run osmo-hlr_10.42.42.2(pid=6101): Launched 01:05:26.484364 run osmo-stp_10.42.42.5: Starting osmo-stp 01:05:27.035107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6103): Launched 01:05:27.355060 run osmo-stp_10.42.42.5(pid=6104): Launched 01:05:27.477582 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:05:28.030124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6106): Launched 01:05:28.153105 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:05:28.423063 run patchelf(pid=6107): Launched 01:05:28.601264 run osmo-stp_10.42.42.5(pid=6104): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6104)] 01:05:28.736081 run osmo-stp_10.42.42.5(pid=6104): stdout: | (launched: 2022-12-10_01:05:27.297223) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:05:28.872619 run osmo-stp_10.42.42.5(pid=6104): stderr: | 20221210010527486 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010527486 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010527487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010527487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010527487 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010527488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010527488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:05:29.009254 run osmo-stp_10.42.42.5(pid=6104): stdout: | (launched: 2022-12-10_01:05:27.297223) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:05:29.141768 run osmo-stp_10.42.42.5(pid=6104): stderr: | 20221210010527486 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010527486 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010527487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010527487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010527487 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010527488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010527488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:05:29.297837 run patchelf(pid=6107): Terminating (SIGINT) 01:05:29.475559 run patchelf(pid=6107): Terminated: ok {rc=0} 01:05:29.604211 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6104): Process ended prematurely: osmo-stp_10.42.42.5(pid=6104) [trial-2367↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6104)] [trial-2367↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 01:05:29.614240 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 01:05:29.642446 run osmo-hlr_10.42.42.2(pid=6101): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6101)] 01:05:29.691912 run osmo-hlr_10.42.42.2(pid=6101): stdout: | (launched: 2022-12-10_01:05:26.304025) 01:05:29.743158 run osmo-hlr_10.42.42.2(pid=6101): stderr: | 20221210010526500 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010526500 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010526500 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010526500 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010526500 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010526500 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010526512 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010526520 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010526521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010526521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:05:29.794965 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6093): Terminating (SIGTERM) 01:05:29.836535 run iperf3-srv_10.42.42.10(pid=6095): Terminating (SIGTERM) 01:05:29.877825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6096): Terminating (SIGTERM) 01:05:29.919206 run iperf3-srv_10.42.42.10(pid=6097): Terminating (SIGTERM) 01:05:29.960439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6100): Terminating (SIGTERM) 01:05:30.002211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6103): Terminating (SIGTERM) 01:05:30.043693 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6106): Terminating (SIGTERM) 01:05:30.085378 --- ParallelTerminationStrategy: PID 6093 died... 01:05:30.105162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6093): Terminated: ok {rc=0} 01:05:30.150818 --- ParallelTerminationStrategy: PID 6095 died... 01:05:30.170178 run iperf3-srv_10.42.42.10(pid=6095): Terminated {rc=256} 01:05:30.216239 --- ParallelTerminationStrategy: PID 6096 died... 01:05:30.235651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6096): Terminated: ok {rc=0} 01:05:30.280743 --- ParallelTerminationStrategy: PID 6097 died... 01:05:30.300058 run iperf3-srv_10.42.42.10(pid=6097): Terminated {rc=256} 01:05:30.345290 --- ParallelTerminationStrategy: PID 6100 died... 01:05:30.364429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6100): Terminated: ok {rc=0} 01:05:30.409734 --- ParallelTerminationStrategy: PID 6103 died... 01:05:30.429595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6103): Terminated: ok {rc=0} 01:05:30.474771 --- ParallelTerminationStrategy: PID 6106 died... 01:05:30.494108 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6106): Terminated: ok {rc=0} 01:05:30.580540 bus /gobi_0: Setting Powered False 01:05:31.685658 bus /gobi_0: Setting Powered False 01:05:32.814277 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 01:05:33.961140 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:33.973163 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:05:34.050709 tst iperf3.py: using LAC 24915 01:05:34.175937 tst iperf3.py: using RAC 180 01:05:34.293428 tst iperf3.py: using CellId 24915 01:05:34.419161 tst iperf3.py: using BVCI 24916 01:05:34.535375 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:34.546782 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:34.558091 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:34.569340 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:34.580320 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:34.591380 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:34.602537 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:34.613816 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:34.624929 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:05:34.738660 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:05:34.939272 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:05:35.236596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6108): Launched 01:05:35.496470 run iperf3-srv_10.42.42.10(pid=6109): Launched 01:05:35.609868 tst iperf3.py:8: start network... 01:05:35.808372 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:05:36.268913 run create_hlr_db(pid=6110): Launched 01:05:36.384790 bus /gobi_6: Setting Powered False 01:05:37.445185 run create_hlr_db(pid=6110): Terminated: ok {rc=0} 01:05:37.880019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6112): Launched 01:05:38.200499 run osmo-hlr_10.42.42.2(pid=6113): Launched 01:05:38.323377 run osmo-stp_10.42.42.5: Starting osmo-stp 01:05:38.874421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6115): Launched 01:05:39.193209 run osmo-stp_10.42.42.5(pid=6116): Launched 01:05:39.315958 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:05:39.868552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6118): Launched 01:05:39.990998 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:05:40.260569 run patchelf(pid=6119): Launched 01:05:40.437920 run osmo-stp_10.42.42.5(pid=6116): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6116)] 01:05:40.572193 run osmo-stp_10.42.42.5(pid=6116): stdout: | (launched: 2022-12-10_01:05:39.135326) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:05:40.708271 run osmo-stp_10.42.42.5(pid=6116): stderr: | 20221210010539327 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010539327 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010539327 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010539327 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010539328 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010539328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010539328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:05:40.844256 run osmo-stp_10.42.42.5(pid=6116): stdout: | (launched: 2022-12-10_01:05:39.135326) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:05:40.975121 run osmo-stp_10.42.42.5(pid=6116): stderr: | 20221210010539327 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010539327 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010539327 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010539327 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010539328 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010539328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010539328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:05:41.129788 run patchelf(pid=6119): Terminating (SIGINT) 01:05:41.307418 run patchelf(pid=6119): Terminated: ok {rc=0} 01:05:41.435199 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6116): Process ended prematurely: osmo-stp_10.42.42.5(pid=6116) [trial-2367↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6116)] [trial-2367↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 01:05:41.445263 tst iperf3.py:8: Test FAILED (7.5 sec) 01:05:41.473663 run osmo-hlr_10.42.42.2(pid=6113): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6113)] 01:05:41.523169 run osmo-hlr_10.42.42.2(pid=6113): stdout: | (launched: 2022-12-10_01:05:38.142551) 01:05:41.574563 run osmo-hlr_10.42.42.2(pid=6113): stderr: | 20221210010538341 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010538341 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010538341 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010538341 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010538341 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010538341 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010538354 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010538362 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010538362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010538362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:05:41.626388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6108): Terminating (SIGTERM) 01:05:41.667537 run iperf3-srv_10.42.42.10(pid=6109): Terminating (SIGTERM) 01:05:41.708602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6112): Terminating (SIGTERM) 01:05:41.749871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6115): Terminating (SIGTERM) 01:05:41.791026 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6118): Terminating (SIGTERM) 01:05:41.832556 --- ParallelTerminationStrategy: PID 6108 died... 01:05:41.852346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6108): Terminated: ok {rc=0} 01:05:41.898174 --- ParallelTerminationStrategy: PID 6109 died... 01:05:41.917491 run iperf3-srv_10.42.42.10(pid=6109): Terminated {rc=256} 01:05:41.963433 --- ParallelTerminationStrategy: PID 6112 died... 01:05:41.982847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6112): Terminated: ok {rc=0} 01:05:42.028633 --- ParallelTerminationStrategy: PID 6115 died... 01:05:42.048109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6115): Terminated: ok {rc=0} 01:05:42.094617 --- ParallelTerminationStrategy: PID 6118 died... 01:05:42.114174 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6118): Terminated: ok {rc=0} 01:05:42.201597 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 01:05:43.347867 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:43.362244 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:05:43.432078 tst iperf3m4.py: using LAC 24916 01:05:43.550397 tst iperf3m4.py: using RAC 181 01:05:43.667042 tst iperf3m4.py: using CellId 24916 01:05:43.793464 tst iperf3m4.py: using BVCI 24917 01:05:43.908825 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:43.920327 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:43.931756 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:43.943302 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:43.954763 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:43.966394 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:43.978042 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:43.989724 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:44.001156 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:05:44.118780 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:05:44.234938 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:05:44.350672 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:05:44.468378 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:05:44.685515 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:05:45.005425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6120): Launched 01:05:45.286133 run iperf3-srv_10.42.42.10(pid=6121): Launched 01:05:45.407222 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:05:45.621806 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:05:45.972738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6122): Launched 01:05:46.318213 run iperf3-srv_10.42.42.10(pid=6123): Launched 01:05:46.451959 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:05:46.658067 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:05:46.980468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6124): Launched 01:05:47.253354 run iperf3-srv_10.42.42.10(pid=6125): Launched 01:05:47.366827 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:05:47.565726 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:05:47.863756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6126): Launched 01:05:48.123014 run iperf3-srv_10.42.42.10(pid=6127): Launched 01:05:48.235396 tst iperf3m4.py:8: start network... 01:05:48.433290 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:05:48.895702 run create_hlr_db(pid=6128): Launched 01:05:49.010098 bus /gobi_6: Setting Powered False 01:05:50.069278 run create_hlr_db(pid=6128): Terminated: ok {rc=0} 01:05:50.506135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6130): Launched 01:05:50.827182 run osmo-hlr_10.42.42.2(pid=6131): Launched 01:05:50.950952 run osmo-stp_10.42.42.5: Starting osmo-stp 01:05:51.501205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6133): Launched 01:05:51.820318 run osmo-stp_10.42.42.5(pid=6134): Launched 01:05:51.942356 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:05:52.491673 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6136): Launched 01:05:52.614455 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:05:52.883724 run patchelf(pid=6137): Launched 01:05:53.061554 run osmo-stp_10.42.42.5(pid=6134): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6134)] 01:05:53.196255 run osmo-stp_10.42.42.5(pid=6134): stdout: | (launched: 2022-12-10_01:05:51.762430) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:05:53.333327 run osmo-stp_10.42.42.5(pid=6134): stderr: | 20221210010551954 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010551955 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010551955 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010551955 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010551956 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010551956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010551956 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:05:53.469904 run osmo-stp_10.42.42.5(pid=6134): stdout: | (launched: 2022-12-10_01:05:51.762430) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:05:53.600888 run osmo-stp_10.42.42.5(pid=6134): stderr: | 20221210010551954 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010551955 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010551955 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010551955 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010551956 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010551956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010551956 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:05:53.756349 run patchelf(pid=6137): Terminating (SIGINT) 01:05:53.934016 run patchelf(pid=6137): Terminated: ok {rc=0} 01:05:54.062043 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6134): Process ended prematurely: osmo-stp_10.42.42.5(pid=6134) [trial-2367↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6134)] [trial-2367↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 01:05:54.072013 tst iperf3m4.py:8: Test FAILED (10.8 sec) 01:05:54.100827 run osmo-hlr_10.42.42.2(pid=6131): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6131)] 01:05:54.151093 run osmo-hlr_10.42.42.2(pid=6131): stdout: | (launched: 2022-12-10_01:05:50.769005) 01:05:54.203413 run osmo-hlr_10.42.42.2(pid=6131): stderr: | 20221210010550965 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010550965 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010550965 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010550965 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010550965 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010550966 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010550978 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010550987 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010550987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010550987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:05:54.255374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6120): Terminating (SIGTERM) 01:05:54.297276 run iperf3-srv_10.42.42.10(pid=6121): Terminating (SIGTERM) 01:05:54.339118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6122): Terminating (SIGTERM) 01:05:54.380842 run iperf3-srv_10.42.42.10(pid=6123): Terminating (SIGTERM) 01:05:54.422615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6124): Terminating (SIGTERM) 01:05:54.464239 run iperf3-srv_10.42.42.10(pid=6125): Terminating (SIGTERM) 01:05:54.505881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6126): Terminating (SIGTERM) 01:05:54.547522 run iperf3-srv_10.42.42.10(pid=6127): Terminating (SIGTERM) 01:05:54.588911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6130): Terminating (SIGTERM) 01:05:54.630668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6133): Terminating (SIGTERM) 01:05:54.672374 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6136): Terminating (SIGTERM) 01:05:54.714288 --- ParallelTerminationStrategy: PID 6120 died... 01:05:54.734631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6120): Terminated: ok {rc=0} 01:05:54.781090 --- ParallelTerminationStrategy: PID 6121 died... 01:05:54.800518 run iperf3-srv_10.42.42.10(pid=6121): Terminated {rc=256} 01:05:54.846530 --- ParallelTerminationStrategy: PID 6122 died... 01:05:54.866108 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6122): Terminated: ok {rc=0} 01:05:54.912675 --- ParallelTerminationStrategy: PID 6123 died... 01:05:54.932292 run iperf3-srv_10.42.42.10(pid=6123): Terminated {rc=256} 01:05:54.978840 --- ParallelTerminationStrategy: PID 6124 died... 01:05:54.998584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6124): Terminated: ok {rc=0} 01:05:55.044720 --- ParallelTerminationStrategy: PID 6125 died... 01:05:55.064327 run iperf3-srv_10.42.42.10(pid=6125): Terminated {rc=256} 01:05:55.110429 --- ParallelTerminationStrategy: PID 6126 died... 01:05:55.130141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6126): Terminated: ok {rc=0} 01:05:55.176169 --- ParallelTerminationStrategy: PID 6127 died... 01:05:55.195583 run iperf3-srv_10.42.42.10(pid=6127): Terminated {rc=256} 01:05:55.241947 --- ParallelTerminationStrategy: PID 6130 died... 01:05:55.261782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6130): Terminated: ok {rc=0} 01:05:55.307738 --- ParallelTerminationStrategy: PID 6133 died... 01:05:55.327202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6133): Terminated: ok {rc=0} 01:05:55.373605 --- ParallelTerminationStrategy: PID 6136 died... 01:05:55.393290 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6136): Terminated: ok {rc=0} 01:05:55.480380 bus /gobi_4: Setting Powered False 01:05:56.579434 bus /gobi_4: Setting Powered False 01:05:57.695505 bus /gobi_1: Setting Powered False 01:05:58.795060 bus /gobi_1: Setting Powered False 01:05:59.908889 bus /gobi_0: Setting Powered False 01:06:01.006718 bus /gobi_0: Setting Powered False 01:06:02.129490 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 01:06:03.234377 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:03.246418 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:06:03.317691 tst ping.py: using LAC 24917 01:06:03.433437 tst ping.py: using RAC 182 01:06:03.549106 tst ping.py: using CellId 24917 01:06:03.663960 tst ping.py: using BVCI 24918 01:06:03.770813 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:03.781863 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:03.792417 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:03.803711 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:03.814890 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:03.826192 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:03.837174 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:03.847954 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:06:03.963341 tst ping.py:19: start network... 01:06:04.174012 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:06:04.659592 run create_hlr_db(pid=6138): Launched 01:06:04.788346 bus /gobi_6: Setting Powered False 01:06:05.850791 run create_hlr_db(pid=6138): Terminated: ok {rc=0} 01:06:06.289255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6140): Launched 01:06:06.603554 run osmo-hlr_10.42.42.2(pid=6141): Launched 01:06:06.723220 run osmo-stp_10.42.42.5: Starting osmo-stp 01:06:07.268515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6143): Launched 01:06:07.580653 run osmo-stp_10.42.42.5(pid=6144): Launched 01:06:07.700362 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:06:08.238918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6146): Launched 01:06:08.359740 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:06:08.623668 run patchelf(pid=6147): Launched 01:06:08.799012 run osmo-stp_10.42.42.5(pid=6144): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6144)] 01:06:08.931400 run osmo-stp_10.42.42.5(pid=6144): stdout: | (launched: 2022-12-10_01:06:07.523887) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:06:09.065377 run osmo-stp_10.42.42.5(pid=6144): stderr: | 20221210010607715 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010607715 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010607716 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010607716 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010607717 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010607717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010607717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:06:09.199279 run osmo-stp_10.42.42.5(pid=6144): stdout: | (launched: 2022-12-10_01:06:07.523887) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:06:09.328931 run osmo-stp_10.42.42.5(pid=6144): stderr: | 20221210010607715 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010607715 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010607716 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010607716 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010607717 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010607717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010607717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:06:09.481488 run patchelf(pid=6147): Terminating (SIGINT) 01:06:09.655995 run patchelf(pid=6147): Terminated: ok {rc=0} 01:06:09.781617 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6144): Process ended prematurely: osmo-stp_10.42.42.5(pid=6144) [trial-2367↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6144)] [trial-2367↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 01:06:09.790824 tst ping.py:22: Test FAILED (6.5 sec) 01:06:09.818970 run osmo-hlr_10.42.42.2(pid=6141): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6141)] 01:06:09.868525 run osmo-hlr_10.42.42.2(pid=6141): stdout: | (launched: 2022-12-10_01:06:06.546115) 01:06:09.919797 run osmo-hlr_10.42.42.2(pid=6141): stderr: | 20221210010606747 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010606748 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010606748 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010606748 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010606748 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010606748 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010606760 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010606769 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010606769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010606769 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:06:09.971528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6140): Terminating (SIGTERM) 01:06:10.013138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6143): Terminating (SIGTERM) 01:06:10.054780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6146): Terminating (SIGTERM) 01:06:10.097196 --- ParallelTerminationStrategy: PID 6140 died... 01:06:10.117188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6140): Terminated: ok {rc=0} 01:06:10.163318 --- ParallelTerminationStrategy: PID 6143 died... 01:06:10.182803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6143): Terminated: ok {rc=0} 01:06:10.229137 --- ParallelTerminationStrategy: PID 6146 died... 01:06:10.248567 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6146): Terminated: ok {rc=0} 01:06:10.336392 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 01:06:11.425078 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:11.437498 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:06:11.510825 tst ping_idle_ping.py: using LAC 24918 01:06:11.635766 tst ping_idle_ping.py: using RAC 183 01:06:11.759209 tst ping_idle_ping.py: using CellId 24918 01:06:11.881574 tst ping_idle_ping.py: using BVCI 24919 01:06:11.995577 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:12.006863 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:12.017919 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:12.029146 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:12.040216 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:12.051398 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:12.062655 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:12.073676 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:06:12.189841 tst ping_idle_ping.py:24: start network... 01:06:12.387354 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:06:12.843359 run create_hlr_db(pid=6148): Launched 01:06:12.955920 bus /gobi_6: Setting Powered False 01:06:14.014008 run create_hlr_db(pid=6148): Terminated: ok {rc=0} 01:06:14.442767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6150): Launched 01:06:14.756402 run osmo-hlr_10.42.42.2(pid=6151): Launched 01:06:14.876882 run osmo-stp_10.42.42.5: Starting osmo-stp 01:06:15.420741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6153): Launched 01:06:15.734785 run osmo-stp_10.42.42.5(pid=6154): Launched 01:06:15.897762 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:06:16.519869 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6156): Launched 01:06:16.647068 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:06:16.919336 run patchelf(pid=6157): Launched 01:06:17.103373 run osmo-stp_10.42.42.5(pid=6154): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6154)] 01:06:17.235228 run osmo-stp_10.42.42.5(pid=6154): stdout: | (launched: 2022-12-10_01:06:15.677123) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:06:17.361791 run osmo-stp_10.42.42.5(pid=6154): stderr: | 20221210010615918 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010615918 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010615918 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010615919 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010615925 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010615925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010615925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:06:17.488352 run osmo-stp_10.42.42.5(pid=6154): stdout: | (launched: 2022-12-10_01:06:15.677123) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:06:17.609674 run osmo-stp_10.42.42.5(pid=6154): stderr: | 20221210010615918 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010615918 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010615918 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010615919 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010615925 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010615925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010615925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:06:17.752202 run patchelf(pid=6157): Terminating (SIGINT) 01:06:17.916051 run patchelf(pid=6157): Terminated: ok {rc=0} 01:06:18.034449 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6154): Process ended prematurely: osmo-stp_10.42.42.5(pid=6154) [trial-2367↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6154)] [trial-2367↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 01:06:18.043372 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 01:06:18.070250 run osmo-hlr_10.42.42.2(pid=6151): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6151)] 01:06:18.118034 run osmo-hlr_10.42.42.2(pid=6151): stdout: | (launched: 2022-12-10_01:06:14.699602) 01:06:18.166803 run osmo-hlr_10.42.42.2(pid=6151): stderr: | 20221210010614898 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010614898 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010614898 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010614898 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010614899 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010614899 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010614912 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010614922 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010614922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010614922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:06:18.216578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6150): Terminating (SIGTERM) 01:06:18.256324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6153): Terminating (SIGTERM) 01:06:18.296212 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6156): Terminating (SIGTERM) 01:06:18.336053 --- ParallelTerminationStrategy: PID 6150 died... 01:06:18.355221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6150): Terminated: ok {rc=0} 01:06:18.399351 --- ParallelTerminationStrategy: PID 6153 died... 01:06:18.417842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6153): Terminated: ok {rc=0} 01:06:18.461781 --- ParallelTerminationStrategy: PID 6156 died... 01:06:18.480389 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6156): Terminated: ok {rc=0} 01:06:18.565606 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 01:06:19.867290 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:06:19.873609 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 01:06:19.907329 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 01:06:19.944931 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 01:06:20.030118 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 01:06:20.062974 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 01:06:20.100878 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 01:06:20.697828 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 01:06:20.746618 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:20.758085 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:06:20.820705 tst cs_paging_gprs_active.py: using LAC 24919 01:06:20.950676 tst cs_paging_gprs_active.py: using RAC 184 01:06:21.067402 tst cs_paging_gprs_active.py: using CellId 24919 01:06:21.182689 tst cs_paging_gprs_active.py: using BVCI 24920 01:06:21.290737 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:21.302021 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:21.312882 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:21.324252 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:21.335612 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:21.346911 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:21.358309 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:21.369646 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:21.380917 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:06:21.499774 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:06:21.614726 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:06:21.815786 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:06:22.116540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6161): Launched 01:06:22.376093 run iperf3-srv_10.42.42.10(pid=6162): Launched 01:06:22.489565 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:06:22.689053 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:06:22.988041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6163): Launched 01:06:23.249109 run iperf3-srv_10.42.42.10(pid=6164): Launched 01:06:23.362007 tst cs_paging_gprs_active.py:38: start network... 01:06:23.561007 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:06:24.021613 run create_hlr_db(pid=6165): Launched 01:06:24.136627 bus /gobi_6: Setting Powered False 01:06:25.196878 run create_hlr_db(pid=6165): Terminated: ok {rc=0} 01:06:25.633754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6167): Launched 01:06:25.953619 run osmo-hlr_10.42.42.2(pid=6168): Launched 01:06:26.077307 run osmo-stp_10.42.42.5: Starting osmo-stp 01:06:26.631964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6170): Launched 01:06:26.951126 run osmo-stp_10.42.42.5(pid=6171): Launched 01:06:27.073904 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:06:27.626381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6173): Launched 01:06:27.749627 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:06:28.019934 run patchelf(pid=6174): Launched 01:06:28.199081 run osmo-stp_10.42.42.5(pid=6171): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6171)] 01:06:28.334748 run osmo-stp_10.42.42.5(pid=6171): stdout: | (launched: 2022-12-10_01:06:26.893396) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:06:28.472103 run osmo-stp_10.42.42.5(pid=6171): stderr: | 20221210010627085 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010627085 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010627085 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010627086 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010627086 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010627086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010627086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:06:28.608858 run osmo-stp_10.42.42.5(pid=6171): stdout: | (launched: 2022-12-10_01:06:26.893396) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:06:28.739901 run osmo-stp_10.42.42.5(pid=6171): stderr: | 20221210010627085 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010627085 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010627085 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010627086 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010627086 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010627086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010627086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:06:28.895528 run patchelf(pid=6174): Terminating (SIGINT) 01:06:29.074005 run patchelf(pid=6174): Terminated: ok {rc=0} 01:06:29.202683 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6171): Process ended prematurely: osmo-stp_10.42.42.5(pid=6171) [trial-2367↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6171)] [trial-2367↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 01:06:29.212682 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 01:06:29.241883 run osmo-hlr_10.42.42.2(pid=6168): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6168)] 01:06:29.292139 run osmo-hlr_10.42.42.2(pid=6168): stdout: | (launched: 2022-12-10_01:06:25.895878) 01:06:29.344067 run osmo-hlr_10.42.42.2(pid=6168): stderr: | 20221210010626094 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010626094 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010626094 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010626094 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010626094 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010626094 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010626106 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010626116 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010626116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010626116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:06:29.396491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6161): Terminating (SIGTERM) 01:06:29.438404 run iperf3-srv_10.42.42.10(pid=6162): Terminating (SIGTERM) 01:06:29.480214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6163): Terminating (SIGTERM) 01:06:29.522531 run iperf3-srv_10.42.42.10(pid=6164): Terminating (SIGTERM) 01:06:29.564323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6167): Terminating (SIGTERM) 01:06:29.606096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6170): Terminating (SIGTERM) 01:06:29.647742 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6173): Terminating (SIGTERM) 01:06:29.689690 --- ParallelTerminationStrategy: PID 6161 died... 01:06:29.709727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6161): Terminated: ok {rc=0} 01:06:29.755979 --- ParallelTerminationStrategy: PID 6162 died... 01:06:29.775606 run iperf3-srv_10.42.42.10(pid=6162): Terminated {rc=256} 01:06:29.821348 --- ParallelTerminationStrategy: PID 6163 died... 01:06:29.840912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6163): Terminated: ok {rc=0} 01:06:29.886982 --- ParallelTerminationStrategy: PID 6164 died... 01:06:29.906530 run iperf3-srv_10.42.42.10(pid=6164): Terminated {rc=256} 01:06:29.952799 --- ParallelTerminationStrategy: PID 6167 died... 01:06:29.972787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6167): Terminated: ok {rc=0} 01:06:30.018911 --- ParallelTerminationStrategy: PID 6170 died... 01:06:30.038584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6170): Terminated: ok {rc=0} 01:06:30.084588 --- ParallelTerminationStrategy: PID 6173 died... 01:06:30.104408 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6173): Terminated: ok {rc=0} 01:06:30.191872 bus /gobi_0: Setting Powered False 01:06:31.297407 bus /gobi_0: Setting Powered False 01:06:32.425418 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 01:06:33.570981 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:33.583039 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:06:33.641848 tst iperf3.py: using LAC 24920 01:06:33.758868 tst iperf3.py: using RAC 185 01:06:33.875969 tst iperf3.py: using CellId 24920 01:06:33.990192 tst iperf3.py: using BVCI 24921 01:06:34.097674 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:34.108780 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:34.120090 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:34.131375 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:34.142708 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:34.154204 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:34.165714 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:34.176762 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:34.188128 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:06:34.305455 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:06:34.522468 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:06:34.843010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6175): Launched 01:06:35.122481 run iperf3-srv_10.42.42.10(pid=6176): Launched 01:06:35.244565 tst iperf3.py:8: start network... 01:06:35.459445 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:06:35.953417 run create_hlr_db(pid=6177): Launched 01:06:36.084477 bus /gobi_6: Setting Powered False 01:06:37.147912 run create_hlr_db(pid=6177): Terminated: ok {rc=0} 01:06:37.591788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6179): Launched 01:06:37.911334 run osmo-hlr_10.42.42.2(pid=6180): Launched 01:06:38.034372 run osmo-stp_10.42.42.5: Starting osmo-stp 01:06:38.583948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6182): Launched 01:06:38.903204 run osmo-stp_10.42.42.5(pid=6183): Launched 01:06:39.026504 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:06:39.577852 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6185): Launched 01:06:39.701049 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:06:39.971498 run patchelf(pid=6186): Launched 01:06:40.149696 run osmo-stp_10.42.42.5(pid=6183): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6183)] 01:06:40.285087 run osmo-stp_10.42.42.5(pid=6183): stdout: | (launched: 2022-12-10_01:06:38.845203) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:06:40.421678 run osmo-stp_10.42.42.5(pid=6183): stderr: | 20221210010639038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010639038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010639039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010639039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010639039 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010639039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010639040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:06:40.558715 run osmo-stp_10.42.42.5(pid=6183): stdout: | (launched: 2022-12-10_01:06:38.845203) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:06:40.689613 run osmo-stp_10.42.42.5(pid=6183): stderr: | 20221210010639038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010639038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010639039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010639039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010639039 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010639039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010639040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:06:40.846661 run patchelf(pid=6186): Terminating (SIGINT) 01:06:41.024893 run patchelf(pid=6186): Terminated: ok {rc=0} 01:06:41.153598 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6183): Process ended prematurely: osmo-stp_10.42.42.5(pid=6183) [trial-2367↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6183)] [trial-2367↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 01:06:41.163670 tst iperf3.py:8: Test FAILED (7.6 sec) 01:06:41.192372 run osmo-hlr_10.42.42.2(pid=6180): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6180)] 01:06:41.242718 run osmo-hlr_10.42.42.2(pid=6180): stdout: | (launched: 2022-12-10_01:06:37.853300) 01:06:41.294416 run osmo-hlr_10.42.42.2(pid=6180): stderr: | 20221210010638051 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010638051 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010638051 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010638051 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010638051 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010638051 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010638063 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010638071 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010638071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010638071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:06:41.346289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6175): Terminating (SIGTERM) 01:06:41.387997 run iperf3-srv_10.42.42.10(pid=6176): Terminating (SIGTERM) 01:06:41.429538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6179): Terminating (SIGTERM) 01:06:41.471318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6182): Terminating (SIGTERM) 01:06:41.513079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6185): Terminating (SIGTERM) 01:06:41.554933 --- ParallelTerminationStrategy: PID 6175 died... 01:06:41.574958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6175): Terminated: ok {rc=0} 01:06:41.620892 --- ParallelTerminationStrategy: PID 6176 died... 01:06:41.640618 run iperf3-srv_10.42.42.10(pid=6176): Terminated {rc=256} 01:06:41.686416 --- ParallelTerminationStrategy: PID 6179 died... 01:06:41.705931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6179): Terminated: ok {rc=0} 01:06:41.751583 --- ParallelTerminationStrategy: PID 6182 died... 01:06:41.771080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6182): Terminated: ok {rc=0} 01:06:41.817103 --- ParallelTerminationStrategy: PID 6185 died... 01:06:41.836510 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6185): Terminated: ok {rc=0} 01:06:41.924442 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 01:06:43.077959 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:43.090611 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:06:43.143154 tst iperf3m4.py: using LAC 24921 01:06:43.270294 tst iperf3m4.py: using RAC 186 01:06:43.401720 tst iperf3m4.py: using CellId 24921 01:06:43.526514 tst iperf3m4.py: using BVCI 24922 01:06:43.642890 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:43.654521 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:43.665990 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:43.677396 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:43.688889 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:43.700279 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:43.711804 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:43.723099 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:43.734661 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:06:43.850769 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:06:43.972045 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:06:44.089339 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:06:44.210990 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:06:44.427900 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:06:44.748666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6187): Launched 01:06:45.011363 run iperf3-srv_10.42.42.10(pid=6188): Launched 01:06:45.124574 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:06:45.323931 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:06:45.622771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6189): Launched 01:06:45.893794 run iperf3-srv_10.42.42.10(pid=6190): Launched 01:06:46.013412 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:06:46.219110 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:06:46.539093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6191): Launched 01:06:46.817772 run iperf3-srv_10.42.42.10(pid=6192): Launched 01:06:46.942603 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:06:47.145739 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:06:47.447596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6193): Launched 01:06:47.708325 run iperf3-srv_10.42.42.10(pid=6194): Launched 01:06:47.820750 tst iperf3m4.py:8: start network... 01:06:48.019491 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:06:48.478634 run create_hlr_db(pid=6195): Launched 01:06:48.594402 bus /gobi_6: Setting Powered False 01:06:49.653301 run create_hlr_db(pid=6195): Terminated: ok {rc=0} 01:06:50.067828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6197): Launched 01:06:50.366979 run osmo-hlr_10.42.42.2(pid=6198): Launched 01:06:50.482329 run osmo-stp_10.42.42.5: Starting osmo-stp 01:06:51.011756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6200): Launched 01:06:51.309435 run osmo-stp_10.42.42.5(pid=6201): Launched 01:06:51.424648 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:06:51.939671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6203): Launched 01:06:52.053967 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:06:52.305202 run patchelf(pid=6204): Launched 01:06:52.471768 run osmo-stp_10.42.42.5(pid=6201): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6201)] 01:06:52.597454 run osmo-stp_10.42.42.5(pid=6201): stdout: | (launched: 2022-12-10_01:06:51.255062) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:06:52.725085 run osmo-stp_10.42.42.5(pid=6201): stderr: | 20221210010651425 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010651425 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010651425 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010651426 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010651426 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010651426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010651426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:06:52.852724 run osmo-stp_10.42.42.5(pid=6201): stdout: | (launched: 2022-12-10_01:06:51.255062) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:06:52.975217 run osmo-stp_10.42.42.5(pid=6201): stderr: | 20221210010651425 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010651425 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010651425 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010651426 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010651426 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010651426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010651426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:06:53.120259 run patchelf(pid=6204): Terminating (SIGINT) 01:06:53.287250 run patchelf(pid=6204): Terminated: ok {rc=0} 01:06:53.407848 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6201): Process ended prematurely: osmo-stp_10.42.42.5(pid=6201) [trial-2367↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6201)] [trial-2367↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 01:06:53.417501 tst iperf3m4.py:8: Test FAILED (10.4 sec) 01:06:53.445733 run osmo-hlr_10.42.42.2(pid=6198): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6198)] 01:06:53.493370 run osmo-hlr_10.42.42.2(pid=6198): stdout: | (launched: 2022-12-10_01:06:50.312131) 01:06:53.542818 run osmo-hlr_10.42.42.2(pid=6198): stderr: | 20221210010650488 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010650488 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010650488 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010650488 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010650488 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010650488 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010650500 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010650509 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010650509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010650509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:06:53.592587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6187): Terminating (SIGTERM) 01:06:53.632375 run iperf3-srv_10.42.42.10(pid=6188): Terminating (SIGTERM) 01:06:53.671936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6189): Terminating (SIGTERM) 01:06:53.711829 run iperf3-srv_10.42.42.10(pid=6190): Terminating (SIGTERM) 01:06:53.751928 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6191): Terminating (SIGTERM) 01:06:53.791791 run iperf3-srv_10.42.42.10(pid=6192): Terminating (SIGTERM) 01:06:53.831701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6193): Terminating (SIGTERM) 01:06:53.871616 run iperf3-srv_10.42.42.10(pid=6194): Terminating (SIGTERM) 01:06:53.911155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6197): Terminating (SIGTERM) 01:06:53.950901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6200): Terminating (SIGTERM) 01:06:53.990504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6203): Terminating (SIGTERM) 01:06:54.030265 --- ParallelTerminationStrategy: PID 6187 died... 01:06:54.049275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6187): Terminated: ok {rc=0} 01:06:54.093779 --- ParallelTerminationStrategy: PID 6188 died... 01:06:54.112119 run iperf3-srv_10.42.42.10(pid=6188): Terminated {rc=256} 01:06:54.156437 --- ParallelTerminationStrategy: PID 6189 died... 01:06:54.174865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6189): Terminated: ok {rc=0} 01:06:54.218352 --- ParallelTerminationStrategy: PID 6190 died... 01:06:54.236752 run iperf3-srv_10.42.42.10(pid=6190): Terminated {rc=256} 01:06:54.280486 --- ParallelTerminationStrategy: PID 6191 died... 01:06:54.298817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6191): Terminated: ok {rc=0} 01:06:54.342527 --- ParallelTerminationStrategy: PID 6192 died... 01:06:54.360825 run iperf3-srv_10.42.42.10(pid=6192): Terminated {rc=256} 01:06:54.404220 --- ParallelTerminationStrategy: PID 6193 died... 01:06:54.422515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6193): Terminated: ok {rc=0} 01:06:54.465907 --- ParallelTerminationStrategy: PID 6194 died... 01:06:54.484169 run iperf3-srv_10.42.42.10(pid=6194): Terminated {rc=256} 01:06:54.527790 --- ParallelTerminationStrategy: PID 6197 died... 01:06:54.546250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6197): Terminated: ok {rc=0} 01:06:54.589705 --- ParallelTerminationStrategy: PID 6200 died... 01:06:54.607983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6200): Terminated: ok {rc=0} 01:06:54.651713 --- ParallelTerminationStrategy: PID 6203 died... 01:06:54.670234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6203): Terminated: ok {rc=0} 01:06:54.755642 bus /gobi_4: Setting Powered False 01:06:55.854202 bus /gobi_4: Setting Powered False 01:06:56.968096 bus /gobi_1: Setting Powered False 01:06:58.066676 bus /gobi_1: Setting Powered False 01:06:59.178130 bus /gobi_0: Setting Powered False 01:07:00.274960 bus /gobi_0: Setting Powered False 01:07:01.388882 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 01:07:02.488827 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:02.500755 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:07:02.553434 tst ping.py: using LAC 24922 01:07:02.670855 tst ping.py: using RAC 187 01:07:02.785232 tst ping.py: using CellId 24922 01:07:02.900403 tst ping.py: using BVCI 24923 01:07:03.006031 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:03.017437 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:03.028590 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:03.040132 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:03.051733 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:03.063035 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:03.074428 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:03.085685 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:07:03.203810 tst ping.py:19: start network... 01:07:03.414866 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:07:03.899314 run create_hlr_db(pid=6206): Launched 01:07:04.027459 bus /gobi_6: Setting Powered False 01:07:05.089378 run create_hlr_db(pid=6206): Terminated: ok {rc=0} 01:07:05.506924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6208): Launched 01:07:05.799799 run osmo-hlr_10.42.42.2(pid=6209): Launched 01:07:05.911870 run osmo-stp_10.42.42.5: Starting osmo-stp 01:07:06.431702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6211): Launched 01:07:06.725778 run osmo-stp_10.42.42.5(pid=6212): Launched 01:07:06.838763 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:07:07.344655 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6214): Launched 01:07:07.457724 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:07:07.703656 run patchelf(pid=6215): Launched 01:07:07.866699 run osmo-stp_10.42.42.5(pid=6212): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6212)] 01:07:07.989891 run osmo-stp_10.42.42.5(pid=6212): stdout: | (launched: 2022-12-10_01:07:06.671268) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:07:08.114750 run osmo-stp_10.42.42.5(pid=6212): stderr: | 20221210010706840 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010706840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010706840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010706841 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010706841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010706841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010706841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:07:08.239789 run osmo-stp_10.42.42.5(pid=6212): stdout: | (launched: 2022-12-10_01:07:06.671268) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:07:08.360046 run osmo-stp_10.42.42.5(pid=6212): stderr: | 20221210010706840 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010706840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010706840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010706841 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010706841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010706841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010706841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:07:08.502203 run patchelf(pid=6215): Terminating (SIGINT) 01:07:08.665844 run patchelf(pid=6215): Terminated: ok {rc=0} 01:07:08.784110 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6212): Process ended prematurely: osmo-stp_10.42.42.5(pid=6212) [trial-2367↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6212)] [trial-2367↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 01:07:08.793073 tst ping.py:22: Test FAILED (6.3 sec) 01:07:08.819836 run osmo-hlr_10.42.42.2(pid=6209): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6209)] 01:07:08.867046 run osmo-hlr_10.42.42.2(pid=6209): stdout: | (launched: 2022-12-10_01:07:05.746261) 01:07:08.915845 run osmo-hlr_10.42.42.2(pid=6209): stderr: | 20221210010705922 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010705922 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010705922 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010705922 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010705922 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010705922 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010705935 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010705943 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010705943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010705943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:07:08.965371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6208): Terminating (SIGTERM) 01:07:09.004791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6211): Terminating (SIGTERM) 01:07:09.044344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6214): Terminating (SIGTERM) 01:07:09.083814 --- ParallelTerminationStrategy: PID 6208 died... 01:07:09.102800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6208): Terminated: ok {rc=0} 01:07:09.146619 --- ParallelTerminationStrategy: PID 6211 died... 01:07:09.165030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6211): Terminated: ok {rc=0} 01:07:09.208871 --- ParallelTerminationStrategy: PID 6214 died... 01:07:09.227651 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6214): Terminated: ok {rc=0} 01:07:09.311318 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 01:07:10.399097 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:10.411927 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:07:10.468864 tst ping_idle_ping.py: using LAC 24923 01:07:10.594688 tst ping_idle_ping.py: using RAC 188 01:07:10.719663 tst ping_idle_ping.py: using CellId 24923 01:07:10.845102 tst ping_idle_ping.py: using BVCI 24924 01:07:10.959456 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:10.971731 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:10.983312 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:10.995317 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:11.006875 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:11.018709 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:11.030499 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:11.042179 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:07:11.159711 tst ping_idle_ping.py:24: start network... 01:07:11.372728 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:07:11.863584 run create_hlr_db(pid=6216): Launched 01:07:11.992439 bus /gobi_6: Setting Powered False 01:07:13.054765 run create_hlr_db(pid=6216): Terminated: ok {rc=0} 01:07:13.492498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6218): Launched 01:07:13.807435 run osmo-hlr_10.42.42.2(pid=6219): Launched 01:07:13.927830 run osmo-stp_10.42.42.5: Starting osmo-stp 01:07:14.472482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6221): Launched 01:07:14.787867 run osmo-stp_10.42.42.5(pid=6222): Launched 01:07:14.909142 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:07:15.452258 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6224): Launched 01:07:15.573951 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:07:15.851770 run patchelf(pid=6225): Launched 01:07:16.050859 run osmo-stp_10.42.42.5(pid=6222): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6222)] 01:07:16.186175 run osmo-stp_10.42.42.5(pid=6222): stdout: | (launched: 2022-12-10_01:07:14.730362) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:07:16.323453 run osmo-stp_10.42.42.5(pid=6222): stderr: | 20221210010714922 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010714922 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010714923 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010714923 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010714923 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010714923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010714924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:07:16.461050 run osmo-stp_10.42.42.5(pid=6222): stdout: | (launched: 2022-12-10_01:07:14.730362) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:07:16.593200 run osmo-stp_10.42.42.5(pid=6222): stderr: | 20221210010714922 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010714922 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010714923 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010714923 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010714923 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010714923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010714924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:07:16.750846 run patchelf(pid=6225): Terminating (SIGINT) 01:07:16.930765 run patchelf(pid=6225): Terminated: ok {rc=0} 01:07:17.060170 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6222): Process ended prematurely: osmo-stp_10.42.42.5(pid=6222) [trial-2367↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6222)] [trial-2367↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 01:07:17.070419 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 01:07:17.099544 run osmo-hlr_10.42.42.2(pid=6219): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6219)] 01:07:17.150193 run osmo-hlr_10.42.42.2(pid=6219): stdout: | (launched: 2022-12-10_01:07:13.750111) 01:07:17.201909 run osmo-hlr_10.42.42.2(pid=6219): stderr: | 20221210010713945 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010713945 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010713945 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010713945 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010713945 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010713946 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010713958 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010713966 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010713966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010713966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:07:17.254164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6218): Terminating (SIGTERM) 01:07:17.295977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6221): Terminating (SIGTERM) 01:07:17.337726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6224): Terminating (SIGTERM) 01:07:17.379540 --- ParallelTerminationStrategy: PID 6218 died... 01:07:17.399431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6218): Terminated: ok {rc=0} 01:07:17.445474 --- ParallelTerminationStrategy: PID 6221 died... 01:07:17.464807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6221): Terminated: ok {rc=0} 01:07:17.510937 --- ParallelTerminationStrategy: PID 6224 died... 01:07:17.530427 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6224): Terminated: ok {rc=0} 01:07:17.617996 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:07:18.924836 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:07:18.932786 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:07:18.966907 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 01:07:19.001998 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:07:19.060339 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:07:19.094486 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 01:07:19.129494 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:07:19.682710 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2367 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 01:07:19.688331 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:07:19.700020 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:07:19.769502 tst switch_tch_pdch.py: using LAC 24924 01:07:19.892271 tst switch_tch_pdch.py: using RAC 189 01:07:20.013770 tst switch_tch_pdch.py: using CellId 24924 01:07:20.134860 tst switch_tch_pdch.py: using BVCI 24925 01:07:20.249479 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:07:20.261037 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:07:20.272380 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:07:20.283938 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:07:20.295610 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:07:20.307091 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:07:20.318730 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:07:20.330244 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:07:20.443895 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:07:20.561480 tst switch_tch_pdch.py:51: start network... 01:07:20.772034 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:07:21.257800 run create_hlr_db(pid=6230): Launched 01:07:21.386522 bus /gobi_6: Setting Powered False 01:07:22.448804 run create_hlr_db(pid=6230): Terminated: ok {rc=0} 01:07:22.867196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6232): Launched 01:07:23.159184 run osmo-hlr_10.42.42.2(pid=6233): Launched 01:07:23.270956 run osmo-stp_10.42.42.5: Starting osmo-stp 01:07:23.773072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6235): Launched 01:07:24.065756 run osmo-stp_10.42.42.5(pid=6236): Launched 01:07:24.178548 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:07:24.681724 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6238): Launched 01:07:24.793765 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:07:25.039878 run patchelf(pid=6239): Launched 01:07:25.202855 run osmo-stp_10.42.42.5(pid=6236): ERR: Terminated: ERROR {rc=1} [trial-2367↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6236)] 01:07:25.326089 run osmo-stp_10.42.42.5(pid=6236): stdout: | (launched: 2022-12-10_01:07:24.012100) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:07:25.450987 run osmo-stp_10.42.42.5(pid=6236): stderr: | 20221210010724182 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010724182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010724183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010724183 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010724183 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010724183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010724184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:07:25.576125 run osmo-stp_10.42.42.5(pid=6236): stdout: | (launched: 2022-12-10_01:07:24.012100) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:07:25.696038 run osmo-stp_10.42.42.5(pid=6236): stderr: | 20221210010724182 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010724182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010724183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010724183 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010724183 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010724183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010724184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:07:25.838432 run patchelf(pid=6239): Terminating (SIGINT) 01:07:26.001349 run patchelf(pid=6239): Terminated: ok {rc=0} 01:07:26.119071 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=6236): Process ended prematurely: osmo-stp_10.42.42.5(pid=6236) [trial-2367↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6236)] [trial-2367↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 01:07:26.127806 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 01:07:26.154801 run osmo-hlr_10.42.42.2(pid=6233): ERR: Terminated: ERROR {rc=237} [trial-2367↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6233)] 01:07:26.202291 run osmo-hlr_10.42.42.2(pid=6233): stdout: | (launched: 2022-12-10_01:07:23.105567) 01:07:26.250959 run osmo-hlr_10.42.42.2(pid=6233): stderr: | 20221210010723279 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010723279 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010723279 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010723279 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010723279 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010723279 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010723295 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010723305 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010723305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010723305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:07:26.299955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6232): Terminating (SIGTERM) 01:07:26.339560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6235): Terminating (SIGTERM) 01:07:26.379002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6238): Terminating (SIGTERM) 01:07:26.418872 --- ParallelTerminationStrategy: PID 6232 died... 01:07:26.437739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6232): Terminated: ok {rc=0} 01:07:26.481591 --- ParallelTerminationStrategy: PID 6235 died... 01:07:26.499829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6235): Terminated: ok {rc=0} 01:07:26.543489 --- ParallelTerminationStrategy: PID 6238 died... 01:07:26.561789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6238): Terminated: ok {rc=0} 01:07:26.646849 bus /gobi_0: Setting Powered False 01:07:27.746719 bus /gobi_0: Setting Powered False 01:07:28.861176 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 01:07:30.113767 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:07:30.119838 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 01:07:30.153817 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 01:07:30.188455 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 01:07:30.242032 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 01:07:30.275771 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 01:07:30.310645 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 01:07:30.871821 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2367 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 01:07:30.878437 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:07:30.890800 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 01:07:30.967864 tst switch_tch_pdch.py: using LAC 24925 01:07:31.088508 tst switch_tch_pdch.py: using RAC 190 01:07:31.205305 tst switch_tch_pdch.py: using CellId 24925 01:07:31.329292 tst switch_tch_pdch.py: using BVCI 24926 01:07:31.445414 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:07:31.457554 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:07:31.469551 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:07:31.482410 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:07:31.497114 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:07:31.510142 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:07:31.523285 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:07:31.535865 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 01:07:31.653758 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 01:07:31.778180 tst switch_tch_pdch.py:51: start network... 01:07:31.983310 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:07:32.422646 run create_hlr_db(pid=6243): Launched 01:07:32.536451 bus /gobi_6: Setting Powered False 01:07:33.595281 run create_hlr_db(pid=6243): Terminated: ok {rc=0} 01:07:33.995513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6245): Launched 01:07:34.308593 run osmo-hlr_10.42.42.2(pid=6246): Launched 01:07:34.429091 run osmo-stp_10.42.42.5: Starting osmo-stp 01:07:34.940766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6248): Launched 01:07:35.254165 run osmo-stp_10.42.42.5(pid=6249): Launched 01:07:35.373922 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:07:35.890107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6251): Launched 01:07:36.014623 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:07:36.278547 run patchelf(pid=6252): Launched 01:07:36.453468 run osmo-stp_10.42.42.5(pid=6249): ERR: Terminated: ERROR {rc=1} [trial-2367↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6249)] 01:07:36.585927 run osmo-stp_10.42.42.5(pid=6249): stdout: | (launched: 2022-12-10_01:07:35.197388) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:07:36.719810 run osmo-stp_10.42.42.5(pid=6249): stderr: | 20221210010735390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010735390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010735390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010735390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010735391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010735391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010735391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:07:36.853636 run osmo-stp_10.42.42.5(pid=6249): stdout: | (launched: 2022-12-10_01:07:35.197388) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:07:36.982571 run osmo-stp_10.42.42.5(pid=6249): stderr: | 20221210010735390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010735390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010735390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010735390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010735391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010735391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010735391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:07:37.135574 run patchelf(pid=6252): Terminating (SIGINT) 01:07:37.310509 run patchelf(pid=6252): Terminated: ok {rc=0} 01:07:37.436672 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=6249): Process ended prematurely: osmo-stp_10.42.42.5(pid=6249) [trial-2367↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6249)] [trial-2367↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 01:07:37.446045 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 01:07:37.473976 run osmo-hlr_10.42.42.2(pid=6246): ERR: Terminated: ERROR {rc=237} [trial-2367↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6246)] 01:07:37.523843 run osmo-hlr_10.42.42.2(pid=6246): stdout: | (launched: 2022-12-10_01:07:34.251483) 01:07:37.575266 run osmo-hlr_10.42.42.2(pid=6246): stderr: | 20221210010734447 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010734447 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010734447 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010734447 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010734447 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010734447 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010734460 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010734468 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010734469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010734469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:07:37.626916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6245): Terminating (SIGTERM) 01:07:37.668667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6248): Terminating (SIGTERM) 01:07:37.710328 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6251): Terminating (SIGTERM) 01:07:37.751984 --- ParallelTerminationStrategy: PID 6245 died... 01:07:37.772012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6245): Terminated: ok {rc=0} 01:07:37.817967 --- ParallelTerminationStrategy: PID 6248 died... 01:07:37.837501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6248): Terminated: ok {rc=0} 01:07:37.883434 --- ParallelTerminationStrategy: PID 6251 died... 01:07:37.903010 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6251): Terminated: ok {rc=0} 01:07:37.990686 bus /gobi_0: Setting Powered False 01:07:39.089734 bus /gobi_0: Setting Powered False 01:07:40.204991 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 01:07:41.456259 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:07:41.460000 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 01:07:41.493487 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 01:07:41.500071 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 01:07:41.550710 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 01:07:41.583593 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 01:07:41.590208 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 01:07:42.127363 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 01:07:42.132118 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 01:07:42.142783 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 01:07:42.190332 tst mo_mt_sms.py: using LAC 24926 01:07:42.302601 tst mo_mt_sms.py: using RAC 191 01:07:42.417194 tst mo_mt_sms.py: using CellId 24926 01:07:42.540488 tst mo_mt_sms.py: using BVCI 24927 01:07:42.654815 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 01:07:42.771106 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 01:07:42.887219 tst mo_mt_sms.py:9: start nitb and bts... 01:07:43.098626 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:07:43.737713 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6257): Launched 01:07:44.051913 run osmo-nitb_10.42.42.2(pid=6258): Launched 01:07:44.226437 run osmo-nitb_10.42.42.2(pid=6258): ERR: Terminated: ERROR {rc=2} [trial-2367↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6258)] 01:07:44.367560 run osmo-nitb_10.42.42.2(pid=6258): stdout: | (launched: 2022-12-10_01:07:43.994796) 01:07:44.508318 run osmo-nitb_10.42.42.2(pid=6258): stderr: | (launched: 2022-12-10_01:07:44.041555) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:07:44.649598 run osmo-nitb_10.42.42.2(pid=6258): stdout: | (launched: 2022-12-10_01:07:43.994796) 01:07:44.785285 run osmo-nitb_10.42.42.2(pid=6258): stderr: | (launched: 2022-12-10_01:07:44.041555) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=6258): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6258) [trial-2367↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6258)] 01:07:45.171465 tst osmo-nitb_10.42.42.2(pid=6258): stdout: | (launched: 2022-12-10_01:07:43.994796) 01:07:45.298909 tst osmo-nitb_10.42.42.2(pid=6258): stderr: | (launched: 2022-12-10_01:07:44.041555) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:07:45.448116 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=6258): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6258) [trial-2367↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6258)] [trial-2367↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 01:07:45.457255 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 01:07:45.464352 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6257): Terminating (SIGTERM) 01:07:45.674706 --- ParallelTerminationStrategy: PID 6257 died... 01:07:45.696328 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6257): Terminated: ok {rc=0} 01:07:45.783169 bus /sierra_3: Setting Powered False 01:07:46.890620 bus /sierra_3: Setting Powered False 01:07:48.019192 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 sms:trx-sysmocell5000 --------------------------------------------------------------------- 01:07:49.215782 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:07:49.219821 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 01:07:49.254604 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 01:07:49.280634 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 01:07:49.331620 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 01:07:49.364492 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 01:07:49.390453 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 01:07:49.937219 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 01:07:49.941981 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:07:49.952511 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 01:07:50.003079 tst mo_mt_sms.py: using LAC 24927 01:07:50.116514 tst mo_mt_sms.py: using RAC 192 01:07:50.229460 tst mo_mt_sms.py: using CellId 24927 01:07:50.352504 tst mo_mt_sms.py: using BVCI 24928 01:07:50.466515 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:07:50.477818 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:07:50.488819 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:07:50.499866 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:07:50.510778 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:07:50.521868 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 01:07:50.636105 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 01:07:50.748925 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:07:51.200747 run create_hlr_db(pid=6262): Launched 01:07:51.314594 bus /sierra_2: Setting Powered False 01:07:52.373323 run create_hlr_db(pid=6262): Terminated: ok {rc=0} 01:07:52.780804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6264): Launched 01:07:53.072476 run osmo-hlr_10.42.42.2(pid=6265): Launched 01:07:53.184341 run osmo-stp_10.42.42.5: Starting osmo-stp 01:07:53.686116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6267): Launched 01:07:53.977295 run osmo-stp_10.42.42.5(pid=6268): Launched 01:07:54.089885 run osmo-msc_10.42.42.6: Starting osmo-msc 01:07:54.617385 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6270): Launched 01:07:54.911080 run osmo-msc_10.42.42.6(pid=6271): Launched 01:07:55.075396 run osmo-stp_10.42.42.5(pid=6268): ERR: Terminated: ERROR {rc=1} [trial-2367↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6268)] 01:07:55.199650 run osmo-stp_10.42.42.5(pid=6268): stdout: | (launched: 2022-12-10_01:07:53.923860) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:07:55.323657 run osmo-stp_10.42.42.5(pid=6268): stderr: | 20221210010754093 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010754093 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010754094 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010754094 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010754095 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010754095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010754095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:07:55.444429 run osmo-stp_10.42.42.5(pid=6268): stdout: | (launched: 2022-12-10_01:07:53.923860) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:07:55.559819 run osmo-stp_10.42.42.5(pid=6268): stderr: | 20221210010754093 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010754093 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010754094 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010754094 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010754095 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010754095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010754095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:07:55.698218 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=6268): Process ended prematurely: osmo-stp_10.42.42.5(pid=6268) [trial-2367↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6268)] [trial-2367↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 01:07:55.706173 tst mo_mt_sms.py:16: Test FAILED (5.8 sec) 01:07:55.732107 run osmo-hlr_10.42.42.2(pid=6265): ERR: Terminated: ERROR {rc=237} [trial-2367↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6265)] 01:07:55.779304 run osmo-hlr_10.42.42.2(pid=6265): stdout: | (launched: 2022-12-10_01:07:53.018847) 01:07:55.827974 run osmo-hlr_10.42.42.2(pid=6265): stderr: | 20221210010753196 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010753196 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010753196 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010753196 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010753196 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010753196 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010753208 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010753216 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010753217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010753217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:07:55.896330 run osmo-msc_10.42.42.6(pid=6271): ERR: Terminated: ERROR {rc=2} [trial-2367↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6271)] 01:07:55.943245 run osmo-msc_10.42.42.6(pid=6271): stdout: | (launched: 2022-12-10_01:07:54.857335) 01:07:55.991820 run osmo-msc_10.42.42.6(pid=6271): stderr: | 20221210010755128 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210010755128 DLGLOBAL DEBUG validating counter group 0x7f4ae8ee0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210010755128 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210010755129 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210010755129 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210010755129 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210010755131 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210010755131 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210010755131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210010755131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:07:56.041205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6264): Terminating (SIGTERM) 01:07:56.080247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6267): Terminating (SIGTERM) 01:07:56.119726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6270): Terminating (SIGTERM) 01:07:56.159144 --- ParallelTerminationStrategy: PID 6264 died... 01:07:56.177966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6264): Terminated: ok {rc=0} 01:07:56.221345 --- ParallelTerminationStrategy: PID 6267 died... 01:07:56.239347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6267): Terminated: ok {rc=0} 01:07:56.282799 --- ParallelTerminationStrategy: PID 6270 died... 01:07:56.301086 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6270): Terminated: ok {rc=0} 01:07:56.386046 bus /sierra_3: Setting Powered False 01:07:57.485193 bus /sierra_3: Setting Powered False 01:07:58.599752 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 01:07:59.826536 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:07:59.830213 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 01:07:59.863556 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 01:07:59.872682 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 01:07:59.908688 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 01:07:59.943576 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 01:07:59.950707 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 01:08:00.470127 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2367 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 01:08:00.475367 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 01:08:00.486726 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 01:08:00.536866 tst assert_extension.py: using LAC 24928 01:08:00.660585 tst assert_extension.py: using RAC 193 01:08:00.785405 tst assert_extension.py: using CellId 24928 01:08:00.929872 tst assert_extension.py: using BVCI 24929 01:08:01.039445 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 01:08:01.159487 tst assert_extension.py:10: start nitb and bts... 01:08:01.362702 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:08:01.988816 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6276): Launched 01:08:02.329268 run osmo-nitb_10.42.42.2(pid=6287): Launched 01:08:02.517676 run osmo-nitb_10.42.42.2(pid=6287): ERR: Terminated: ERROR {rc=2} [trial-2367↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6287)] 01:08:02.662047 run osmo-nitb_10.42.42.2(pid=6287): stdout: | (launched: 2022-12-10_01:08:02.268023) 01:08:02.809401 run osmo-nitb_10.42.42.2(pid=6287): stderr: | (launched: 2022-12-10_01:08:02.312026) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:08:02.953803 run osmo-nitb_10.42.42.2(pid=6287): stdout: | (launched: 2022-12-10_01:08:02.268023) 01:08:03.092220 run osmo-nitb_10.42.42.2(pid=6287): stderr: | (launched: 2022-12-10_01:08:02.312026) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=6287): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6287) [trial-2367↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6287)] 01:08:03.461293 tst osmo-nitb_10.42.42.2(pid=6287): stdout: | (launched: 2022-12-10_01:08:02.268023) 01:08:03.593250 tst osmo-nitb_10.42.42.2(pid=6287): stderr: | (launched: 2022-12-10_01:08:02.312026) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:08:03.748326 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=6287): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6287) [trial-2367↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6287)] [trial-2367↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 01:08:03.758147 tst assert_extension.py:12: Test FAILED (3.3 sec) 01:08:03.766239 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6276): Terminating (SIGTERM) 01:08:03.979543 --- ParallelTerminationStrategy: PID 6276 died... 01:08:04.002253 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6276): Terminated: ok {rc=0} 01:08:04.091724 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 01:08:05.271087 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:08:05.275470 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 01:08:05.313234 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 01:08:05.341933 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 01:08:05.376535 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 01:08:05.412424 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 01:08:05.442543 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 01:08:05.970978 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2367 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 01:08:05.977641 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:08:05.989839 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 01:08:06.042256 tst assert_extension.py: using LAC 24929 01:08:06.166517 tst assert_extension.py: using RAC 194 01:08:06.293235 tst assert_extension.py: using CellId 24929 01:08:06.418185 tst assert_extension.py: using BVCI 24930 01:08:06.535519 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:08:06.547483 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:08:06.559534 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:08:06.571525 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:08:06.583710 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:08:06.595559 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 01:08:06.715015 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:08:07.218785 run create_hlr_db(pid=6294): Launched 01:08:07.384744 bus /sierra_2: Setting Powered False 01:08:08.450642 run create_hlr_db(pid=6294): Terminated: ok {rc=0} 01:08:08.906281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6296): Launched 01:08:09.245782 run osmo-hlr_10.42.42.2(pid=6297): Launched 01:08:09.498560 run osmo-stp_10.42.42.5: Starting osmo-stp 01:08:10.265252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6299): Launched 01:08:10.602087 run osmo-stp_10.42.42.5(pid=6300): Launched 01:08:10.839691 run osmo-msc_10.42.42.6: Starting osmo-msc 01:08:11.512380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6302): Launched 01:08:11.857737 run osmo-msc_10.42.42.6(pid=6303): Launched 01:08:12.221400 run osmo-stp_10.42.42.5(pid=6300): ERR: Terminated: ERROR {rc=1} [trial-2367↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6300)] 01:08:12.497422 run osmo-stp_10.42.42.5(pid=6300): stdout: | (launched: 2022-12-10_01:08:10.541252) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:08:12.672239 run osmo-stp_10.42.42.5(pid=6300): stderr: | 20221210010810845 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010810846 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010810846 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010810846 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010810847 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010810847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010810847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:08:12.807332 run osmo-stp_10.42.42.5(pid=6300): stdout: | (launched: 2022-12-10_01:08:10.541252) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:08:12.937304 run osmo-stp_10.42.42.5(pid=6300): stderr: | 20221210010810845 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010810846 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010810846 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010810846 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010810847 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010810847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010810847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:08:13.093635 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=6300): Process ended prematurely: osmo-stp_10.42.42.5(pid=6300) [trial-2367↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6300)] [trial-2367↪ussd:trx-sysmocell5000↪assert_extension.py:17] 01:08:13.103459 tst assert_extension.py:17: Test FAILED (7.1 sec) 01:08:13.133431 run osmo-hlr_10.42.42.2(pid=6297): ERR: Terminated: ERROR {rc=237} [trial-2367↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6297)] 01:08:13.185678 run osmo-hlr_10.42.42.2(pid=6297): stdout: | (launched: 2022-12-10_01:08:09.186492) 01:08:13.261595 run osmo-hlr_10.42.42.2(pid=6297): stderr: | 20221210010809493 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010809493 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010809493 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010809493 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010809493 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010809493 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010809511 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010809524 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010809525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010809525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:08:13.337725 run osmo-msc_10.42.42.6(pid=6303): ERR: Terminated: ERROR {rc=2} [trial-2367↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6303)] 01:08:13.402085 run osmo-msc_10.42.42.6(pid=6303): stdout: | (launched: 2022-12-10_01:08:11.787498) 01:08:13.468167 run osmo-msc_10.42.42.6(pid=6303): stderr: | 20221210010812296 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210010812296 DLGLOBAL DEBUG validating counter group 0x7f51cca62c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210010812296 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210010812296 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210010812296 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210010812296 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210010812302 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210010812303 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210010812303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210010812303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:08:13.526193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6296): Terminating (SIGTERM) 01:08:13.570540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6299): Terminating (SIGTERM) 01:08:13.616718 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6302): Terminating (SIGTERM) 01:08:13.661843 --- ParallelTerminationStrategy: PID 6296 died... 01:08:13.682703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6296): Terminated: ok {rc=0} 01:08:13.732588 --- ParallelTerminationStrategy: PID 6299 died... 01:08:13.759242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6299): Terminated: ok {rc=0} 01:08:13.816401 --- ParallelTerminationStrategy: PID 6302 died... 01:08:13.836882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6302): Terminated: ok {rc=0} 01:08:13.941876 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 01:08:15.168916 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:08:15.176754 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 01:08:15.213142 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 01:08:15.241337 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 01:08:15.293413 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 01:08:15.330616 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 01:08:15.359716 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 01:08:15.939325 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 01:08:16.016696 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:08:16.029524 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:08:16.107715 tst mo_mt_call.py: using LAC 24930 01:08:16.281104 tst mo_mt_call.py: using RAC 195 01:08:16.450322 tst mo_mt_call.py: using CellId 24930 01:08:16.583781 tst mo_mt_call.py: using BVCI 24931 01:08:16.730310 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:08:16.744893 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:08:16.760662 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:08:16.776266 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:08:16.790820 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:08:16.805247 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:08:16.946181 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:08:17.085320 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:08:17.584445 run create_hlr_db(pid=6567): Launched 01:08:17.739962 bus /sierra_2: Setting Powered False 01:08:18.804723 run create_hlr_db(pid=6567): Terminated: ok {rc=0} 01:08:19.264172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6569): Launched 01:08:19.610438 run osmo-hlr_10.42.42.2(pid=6570): Launched 01:08:19.861140 run osmo-stp_10.42.42.5: Starting osmo-stp 01:08:20.537436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6572): Launched 01:08:20.884083 run osmo-stp_10.42.42.5(pid=6573): Launched 01:08:21.137179 run osmo-msc_10.42.42.6: Starting osmo-msc 01:08:21.814160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6575): Launched 01:08:22.159535 run osmo-msc_10.42.42.6(pid=6576): Launched 01:08:22.526740 run osmo-stp_10.42.42.5(pid=6573): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6573)] 01:08:22.803059 run osmo-stp_10.42.42.5(pid=6573): stdout: | (launched: 2022-12-10_01:08:20.820251) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:08:22.992904 run osmo-stp_10.42.42.5(pid=6573): stderr: | 20221210010821123 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010821123 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010821123 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010821129 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010821129 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010821129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010821130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:08:23.133141 run osmo-stp_10.42.42.5(pid=6573): stdout: | (launched: 2022-12-10_01:08:20.820251) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:08:23.270150 run osmo-stp_10.42.42.5(pid=6573): stderr: | 20221210010821123 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010821123 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010821123 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010821129 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010821129 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010821129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010821130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:08:23.431866 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6573): Process ended prematurely: osmo-stp_10.42.42.5(pid=6573) [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6573)] [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 01:08:23.442492 tst mo_mt_call.py:8: Test FAILED (7.5 sec) 01:08:23.472276 run osmo-hlr_10.42.42.2(pid=6570): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6570)] 01:08:23.524915 run osmo-hlr_10.42.42.2(pid=6570): stdout: | (launched: 2022-12-10_01:08:19.547797) 01:08:23.580850 run osmo-hlr_10.42.42.2(pid=6570): stderr: | 20221210010819860 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010819860 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010819860 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010819860 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010819860 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010819860 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010819885 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010819901 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010819901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010819901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:08:23.655987 run osmo-msc_10.42.42.6(pid=6576): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6576)] 01:08:23.709178 run osmo-msc_10.42.42.6(pid=6576): stdout: | (launched: 2022-12-10_01:08:22.096601) 01:08:23.764469 run osmo-msc_10.42.42.6(pid=6576): stderr: | 20221210010822608 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210010822608 DLGLOBAL DEBUG validating counter group 0x7fab8420cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210010822613 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210010822613 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210010822613 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210010822613 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210010822615 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210010822616 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210010822616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210010822616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:08:23.819208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6569): Terminating (SIGTERM) 01:08:23.864235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6572): Terminating (SIGTERM) 01:08:23.910407 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6575): Terminating (SIGTERM) 01:08:23.957544 --- ParallelTerminationStrategy: PID 6569 died... 01:08:23.978048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6569): Terminated: ok {rc=0} 01:08:24.028871 --- ParallelTerminationStrategy: PID 6572 died... 01:08:24.049939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6572): Terminated: ok {rc=0} 01:08:24.098247 --- ParallelTerminationStrategy: PID 6575 died... 01:08:24.119082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6575): Terminated: ok {rc=0} 01:08:24.211212 bus /sierra_3: Setting Powered False 01:08:25.311223 bus /sierra_3: Setting Powered False 01:08:26.426048 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 01:08:27.575700 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:08:27.588167 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:08:27.660061 tst mo_mt_call_osmux.py: using LAC 24931 01:08:27.787854 tst mo_mt_call_osmux.py: using RAC 196 01:08:27.913554 tst mo_mt_call_osmux.py: using CellId 24931 01:08:28.038872 tst mo_mt_call_osmux.py: using BVCI 24932 01:08:28.157495 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:08:28.169139 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:08:28.180604 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:08:28.192069 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:08:28.203615 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:08:28.215006 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:08:28.332089 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:08:28.451151 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:08:28.950864 run create_hlr_db(pid=6579): Launched 01:08:29.081942 bus /sierra_2: Setting Powered False 01:08:30.145697 run create_hlr_db(pid=6579): Terminated: ok {rc=0} 01:08:30.575380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6581): Launched 01:08:30.881708 run osmo-hlr_10.42.42.2(pid=6582): Launched 01:08:31.170635 run osmo-stp_10.42.42.5: Starting osmo-stp 01:08:31.792833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6584): Launched 01:08:32.120407 run osmo-stp_10.42.42.5(pid=6585): Launched 01:08:32.392358 run osmo-msc_10.42.42.6: Starting osmo-msc 01:08:32.972257 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6587): Launched 01:08:33.293147 run osmo-msc_10.42.42.6(pid=6588): Launched 01:08:33.476282 run osmo-stp_10.42.42.5(pid=6585): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6585)] 01:08:33.611984 run osmo-stp_10.42.42.5(pid=6585): stdout: | (launched: 2022-12-10_01:08:32.057165) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:08:33.747685 run osmo-stp_10.42.42.5(pid=6585): stderr: | 20221210010832311 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010832311 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010832311 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010832311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010832312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010832312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010832312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:08:33.882334 run osmo-stp_10.42.42.5(pid=6585): stdout: | (launched: 2022-12-10_01:08:32.057165) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:08:34.009899 run osmo-stp_10.42.42.5(pid=6585): stderr: | 20221210010832311 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010832311 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010832311 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010832311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010832312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010832312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010832312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:08:34.162807 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6585): Process ended prematurely: osmo-stp_10.42.42.5(pid=6585) [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6585)] [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 01:08:34.172474 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 01:08:34.200313 run osmo-hlr_10.42.42.2(pid=6582): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6582)] 01:08:34.250462 run osmo-hlr_10.42.42.2(pid=6582): stdout: | (launched: 2022-12-10_01:08:30.822968) 01:08:34.302516 run osmo-hlr_10.42.42.2(pid=6582): stderr: | 20221210010831125 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010831125 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010831125 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010831125 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010831125 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010831125 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010831147 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010831170 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010831171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010831171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:08:34.375115 run osmo-msc_10.42.42.6(pid=6588): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6588)] 01:08:34.424800 run osmo-msc_10.42.42.6(pid=6588): stdout: | (launched: 2022-12-10_01:08:33.234635) 01:08:34.476067 run osmo-msc_10.42.42.6(pid=6588): stderr: | 20221210010833555 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210010833555 DLGLOBAL DEBUG validating counter group 0x7f61a57e1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210010833555 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210010833555 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210010833556 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210010833556 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210010833558 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210010833558 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210010833558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210010833558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:08:34.527772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6581): Terminating (SIGTERM) 01:08:34.569124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6584): Terminating (SIGTERM) 01:08:34.610547 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6587): Terminating (SIGTERM) 01:08:34.652305 --- ParallelTerminationStrategy: PID 6581 died... 01:08:34.672374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6581): Terminated: ok {rc=0} 01:08:34.718879 --- ParallelTerminationStrategy: PID 6584 died... 01:08:34.738428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6584): Terminated: ok {rc=0} 01:08:34.784124 --- ParallelTerminationStrategy: PID 6587 died... 01:08:34.803637 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6587): Terminated: ok {rc=0} 01:08:34.891328 bus /sierra_3: Setting Powered False 01:08:35.991003 bus /sierra_3: Setting Powered False 01:08:37.105932 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 01:08:38.368825 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:08:38.375496 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 01:08:38.409795 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 01:08:38.436313 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 01:08:38.490305 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 01:08:38.524197 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 01:08:38.550518 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 01:08:39.100712 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 01:08:39.149700 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:08:39.160867 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:08:39.230034 tst mo_mt_call.py: using LAC 24932 01:08:39.347638 tst mo_mt_call.py: using RAC 197 01:08:39.466426 tst mo_mt_call.py: using CellId 24932 01:08:39.586299 tst mo_mt_call.py: using BVCI 24933 01:08:39.696715 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:08:39.708007 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:08:39.719066 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:08:39.730365 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:08:39.741989 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:08:39.753396 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:08:39.872561 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:08:39.992478 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:08:40.487346 run create_hlr_db(pid=6593): Launched 01:08:40.619509 bus /sierra_2: Setting Powered False 01:08:41.682565 run create_hlr_db(pid=6593): Terminated: ok {rc=0} 01:08:42.109719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6595): Launched 01:08:42.411784 run osmo-hlr_10.42.42.2(pid=6596): Launched 01:08:42.526694 run osmo-stp_10.42.42.5: Starting osmo-stp 01:08:43.046251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6598): Launched 01:08:43.346658 run osmo-stp_10.42.42.5(pid=6599): Launched 01:08:43.461399 run osmo-msc_10.42.42.6: Starting osmo-msc 01:08:44.009777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6601): Launched 01:08:44.310618 run osmo-msc_10.42.42.6(pid=6602): Launched 01:08:44.480289 run osmo-stp_10.42.42.5(pid=6599): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6599)] 01:08:44.608685 run osmo-stp_10.42.42.5(pid=6599): stdout: | (launched: 2022-12-10_01:08:43.291366) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:08:44.736302 run osmo-stp_10.42.42.5(pid=6599): stderr: | 20221210010843461 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010843461 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010843461 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010843462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010843462 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010843462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010843462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:08:44.861733 run osmo-stp_10.42.42.5(pid=6599): stdout: | (launched: 2022-12-10_01:08:43.291366) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:08:44.981746 run osmo-stp_10.42.42.5(pid=6599): stderr: | 20221210010843461 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010843461 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010843461 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010843462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010843462 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010843462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010843462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:08:45.125554 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6599): Process ended prematurely: osmo-stp_10.42.42.5(pid=6599) [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6599)] [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 01:08:45.134501 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 01:08:45.162276 run osmo-hlr_10.42.42.2(pid=6596): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6596)] 01:08:45.210029 run osmo-hlr_10.42.42.2(pid=6596): stdout: | (launched: 2022-12-10_01:08:42.356302) 01:08:45.259505 run osmo-hlr_10.42.42.2(pid=6596): stderr: | 20221210010842532 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010842532 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010842532 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010842532 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010842532 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010842532 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010842544 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010842554 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010842554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010842554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:08:45.328513 run osmo-msc_10.42.42.6(pid=6602): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6602)] 01:08:45.376339 run osmo-msc_10.42.42.6(pid=6602): stdout: | (launched: 2022-12-10_01:08:44.255097) 01:08:45.425713 run osmo-msc_10.42.42.6(pid=6602): stderr: | 20221210010844526 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210010844527 DLGLOBAL DEBUG validating counter group 0x7f2cb3e22c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210010844527 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210010844527 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210010844527 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210010844527 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210010844529 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210010844529 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210010844529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210010844529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:08:45.475544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6595): Terminating (SIGTERM) 01:08:45.515337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6598): Terminating (SIGTERM) 01:08:45.555148 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6601): Terminating (SIGTERM) 01:08:45.595053 --- ParallelTerminationStrategy: PID 6595 died... 01:08:45.613909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6595): Terminated: ok {rc=0} 01:08:45.658031 --- ParallelTerminationStrategy: PID 6598 died... 01:08:45.676398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6598): Terminated: ok {rc=0} 01:08:45.721053 --- ParallelTerminationStrategy: PID 6601 died... 01:08:45.739529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6601): Terminated: ok {rc=0} 01:08:45.822219 bus /sierra_3: Setting Powered False 01:08:46.931099 bus /sierra_3: Setting Powered False 01:08:48.044124 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 01:08:49.192395 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:08:49.204715 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:08:49.277568 tst mo_mt_call_osmux.py: using LAC 24933 01:08:49.398405 tst mo_mt_call_osmux.py: using RAC 198 01:08:49.515029 tst mo_mt_call_osmux.py: using CellId 24933 01:08:49.634903 tst mo_mt_call_osmux.py: using BVCI 24934 01:08:49.742921 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:08:49.754401 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:08:49.765444 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:08:49.776591 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:08:49.787931 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:08:49.799265 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:08:49.918602 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:08:50.034560 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:08:50.500110 run create_hlr_db(pid=6604): Launched 01:08:50.614549 bus /sierra_2: Setting Powered False 01:08:51.674054 run create_hlr_db(pid=6604): Terminated: ok {rc=0} 01:08:52.112093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6606): Launched 01:08:52.434261 run osmo-hlr_10.42.42.2(pid=6607): Launched 01:08:52.557325 run osmo-stp_10.42.42.5: Starting osmo-stp 01:08:53.113860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6609): Launched 01:08:53.436552 run osmo-stp_10.42.42.5(pid=6610): Launched 01:08:53.560510 run osmo-msc_10.42.42.6: Starting osmo-msc 01:08:54.142251 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6612): Launched 01:08:54.464609 run osmo-msc_10.42.42.6(pid=6613): Launched 01:08:54.644800 run osmo-stp_10.42.42.5(pid=6610): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6610)] 01:08:54.779722 run osmo-stp_10.42.42.5(pid=6610): stdout: | (launched: 2022-12-10_01:08:53.377957) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:08:54.915212 run osmo-stp_10.42.42.5(pid=6610): stderr: | 20221210010853569 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010853570 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010853570 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010853570 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010853571 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010853571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010853571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:08:55.049824 run osmo-stp_10.42.42.5(pid=6610): stdout: | (launched: 2022-12-10_01:08:53.377957) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:08:55.177525 run osmo-stp_10.42.42.5(pid=6610): stderr: | 20221210010853569 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010853570 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010853570 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010853570 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010853571 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010853571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010853571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:08:55.330757 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6610): Process ended prematurely: osmo-stp_10.42.42.5(pid=6610) [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6610)] [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 01:08:55.340476 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 01:08:55.368242 run osmo-hlr_10.42.42.2(pid=6607): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6607)] 01:08:55.417875 run osmo-hlr_10.42.42.2(pid=6607): stdout: | (launched: 2022-12-10_01:08:52.375640) 01:08:55.469299 run osmo-hlr_10.42.42.2(pid=6607): stderr: | 20221210010852574 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010852574 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010852574 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010852574 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010852574 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010852574 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010852586 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010852595 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010852595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010852595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:08:55.540801 run osmo-msc_10.42.42.6(pid=6613): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6613)] 01:08:55.590649 run osmo-msc_10.42.42.6(pid=6613): stdout: | (launched: 2022-12-10_01:08:54.405719) 01:08:55.642512 run osmo-msc_10.42.42.6(pid=6613): stderr: | 20221210010854727 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210010854728 DLGLOBAL DEBUG validating counter group 0x7f550782fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210010854728 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210010854728 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210010854728 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210010854728 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210010854730 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210010854730 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210010854730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210010854730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:08:55.694070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6606): Terminating (SIGTERM) 01:08:55.735439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6609): Terminating (SIGTERM) 01:08:55.777121 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6612): Terminating (SIGTERM) 01:08:55.818810 --- ParallelTerminationStrategy: PID 6606 died... 01:08:55.838278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6606): Terminated: ok {rc=0} 01:08:55.883922 --- ParallelTerminationStrategy: PID 6609 died... 01:08:55.903382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6609): Terminated: ok {rc=0} 01:08:55.948863 --- ParallelTerminationStrategy: PID 6612 died... 01:08:55.968351 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6612): Terminated: ok {rc=0} 01:08:56.055231 bus /sierra_3: Setting Powered False 01:08:57.154320 bus /sierra_3: Setting Powered False 01:08:58.269538 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 01:08:59.526133 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:08:59.532667 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 01:08:59.567154 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 01:08:59.594012 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 01:08:59.644122 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 01:08:59.678881 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 01:08:59.706107 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 01:09:00.256928 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 01:09:00.310620 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:00.322523 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:09:00.393516 tst mo_mt_call.py: using LAC 24934 01:09:00.517863 tst mo_mt_call.py: using RAC 199 01:09:00.635099 tst mo_mt_call.py: using CellId 24934 01:09:00.751774 tst mo_mt_call.py: using BVCI 24935 01:09:00.871712 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:00.884127 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:00.895723 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:00.908134 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:00.920684 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:00.934062 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:09:01.073876 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:09:01.198488 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:09:01.679299 run create_hlr_db(pid=6618): Launched 01:09:01.828470 bus /sierra_2: Setting Powered False 01:09:02.888533 run create_hlr_db(pid=6618): Terminated: ok {rc=0} 01:09:03.306970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6620): Launched 01:09:03.608685 run osmo-hlr_10.42.42.2(pid=6621): Launched 01:09:03.724103 run osmo-stp_10.42.42.5: Starting osmo-stp 01:09:04.244622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6623): Launched 01:09:04.545579 run osmo-stp_10.42.42.5(pid=6624): Launched 01:09:04.662847 run osmo-msc_10.42.42.6: Starting osmo-msc 01:09:05.209384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6626): Launched 01:09:05.510896 run osmo-msc_10.42.42.6(pid=6627): Launched 01:09:05.680147 run osmo-stp_10.42.42.5(pid=6624): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6624)] 01:09:05.807640 run osmo-stp_10.42.42.5(pid=6624): stdout: | (launched: 2022-12-10_01:09:04.490504) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:09:05.934986 run osmo-stp_10.42.42.5(pid=6624): stderr: | 20221210010904662 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010904662 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010904662 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010904663 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010904663 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010904663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010904664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:09:06.059868 run osmo-stp_10.42.42.5(pid=6624): stdout: | (launched: 2022-12-10_01:09:04.490504) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:09:06.179544 run osmo-stp_10.42.42.5(pid=6624): stderr: | 20221210010904662 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010904662 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010904662 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010904663 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010904663 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010904663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010904664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:09:06.323426 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6624): Process ended prematurely: osmo-stp_10.42.42.5(pid=6624) [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6624)] [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 01:09:06.332447 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:09:06.358943 run osmo-hlr_10.42.42.2(pid=6621): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6621)] 01:09:06.406867 run osmo-hlr_10.42.42.2(pid=6621): stdout: | (launched: 2022-12-10_01:09:03.552921) 01:09:06.455813 run osmo-hlr_10.42.42.2(pid=6621): stderr: | 20221210010903731 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010903731 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010903731 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010903731 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010903731 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010903731 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010903744 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010903753 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010903753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010903753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:09:06.524257 run osmo-msc_10.42.42.6(pid=6627): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6627)] 01:09:06.571974 run osmo-msc_10.42.42.6(pid=6627): stdout: | (launched: 2022-12-10_01:09:05.455373) 01:09:06.620796 run osmo-msc_10.42.42.6(pid=6627): stderr: | 20221210010905729 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210010905729 DLGLOBAL DEBUG validating counter group 0x7fbe02effc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210010905730 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210010905730 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210010905730 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210010905730 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210010905732 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210010905732 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210010905732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210010905732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:09:06.670180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6620): Terminating (SIGTERM) 01:09:06.709831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6623): Terminating (SIGTERM) 01:09:06.749435 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6626): Terminating (SIGTERM) 01:09:06.789166 --- ParallelTerminationStrategy: PID 6620 died... 01:09:06.808155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6620): Terminated: ok {rc=0} 01:09:06.852800 --- ParallelTerminationStrategy: PID 6623 died... 01:09:06.871337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6623): Terminated: ok {rc=0} 01:09:06.915157 --- ParallelTerminationStrategy: PID 6626 died... 01:09:06.933726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6626): Terminated: ok {rc=0} 01:09:07.016708 bus /sierra_3: Setting Powered False 01:09:08.114805 bus /sierra_3: Setting Powered False 01:09:09.229932 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 01:09:10.379114 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:10.391733 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:09:10.462742 tst mo_mt_call_osmux.py: using LAC 24935 01:09:10.586760 tst mo_mt_call_osmux.py: using RAC 200 01:09:10.711133 tst mo_mt_call_osmux.py: using CellId 24935 01:09:10.835521 tst mo_mt_call_osmux.py: using BVCI 24936 01:09:10.951836 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:10.963521 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:10.974984 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:10.986536 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:10.998148 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:11.009587 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:09:11.129376 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:09:11.247112 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:09:11.713036 run create_hlr_db(pid=6629): Launched 01:09:11.829792 bus /sierra_2: Setting Powered False 01:09:12.890265 run create_hlr_db(pid=6629): Terminated: ok {rc=0} 01:09:13.333453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6631): Launched 01:09:13.657211 run osmo-hlr_10.42.42.2(pid=6632): Launched 01:09:13.780781 run osmo-stp_10.42.42.5: Starting osmo-stp 01:09:14.334322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6634): Launched 01:09:14.655961 run osmo-stp_10.42.42.5(pid=6635): Launched 01:09:14.779294 run osmo-msc_10.42.42.6: Starting osmo-msc 01:09:15.362138 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6637): Launched 01:09:15.686091 run osmo-msc_10.42.42.6(pid=6638): Launched 01:09:15.918030 run osmo-stp_10.42.42.5(pid=6635): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6635)] 01:09:16.230197 run osmo-stp_10.42.42.5(pid=6635): stdout: | (launched: 2022-12-10_01:09:14.597818) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:09:16.461947 run osmo-stp_10.42.42.5(pid=6635): stderr: | 20221210010914792 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010914792 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010914792 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010914793 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010914793 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010914793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010914793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:09:16.592583 run osmo-stp_10.42.42.5(pid=6635): stdout: | (launched: 2022-12-10_01:09:14.597818) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:09:16.716681 run osmo-stp_10.42.42.5(pid=6635): stderr: | 20221210010914792 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010914792 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010914792 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010914793 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010914793 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010914793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010914793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:09:16.866482 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6635): Process ended prematurely: osmo-stp_10.42.42.5(pid=6635) [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6635)] [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 01:09:16.877317 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 01:09:16.906308 run osmo-hlr_10.42.42.2(pid=6632): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6632)] 01:09:16.958379 run osmo-hlr_10.42.42.2(pid=6632): stdout: | (launched: 2022-12-10_01:09:13.598094) 01:09:17.010992 run osmo-hlr_10.42.42.2(pid=6632): stderr: | 20221210010913796 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010913796 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010913796 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010913796 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010913796 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010913796 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010913811 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010913821 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010913821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010913821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:09:17.084334 run osmo-msc_10.42.42.6(pid=6638): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6638)] 01:09:17.135132 run osmo-msc_10.42.42.6(pid=6638): stdout: | (launched: 2022-12-10_01:09:15.627593) 01:09:17.188385 run osmo-msc_10.42.42.6(pid=6638): stderr: | 20221210010916067 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210010916068 DLGLOBAL DEBUG validating counter group 0x7f7d37947c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210010916068 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210010916068 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210010916068 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210010916068 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210010916070 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210010916070 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210010916071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210010916071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:09:17.241689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6631): Terminating (SIGTERM) 01:09:17.284805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6634): Terminating (SIGTERM) 01:09:17.329044 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6637): Terminating (SIGTERM) 01:09:17.370834 --- ParallelTerminationStrategy: PID 6631 died... 01:09:17.390810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6631): Terminated: ok {rc=0} 01:09:17.435723 --- ParallelTerminationStrategy: PID 6634 died... 01:09:17.454375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6634): Terminated: ok {rc=0} 01:09:17.498660 --- ParallelTerminationStrategy: PID 6637 died... 01:09:17.517255 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6637): Terminated: ok {rc=0} 01:09:17.600573 bus /sierra_3: Setting Powered False 01:09:18.698565 bus /sierra_3: Setting Powered False 01:09:19.813941 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 01:09:21.060715 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:09:21.067171 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 01:09:21.101440 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 01:09:21.127699 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 01:09:21.178960 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 01:09:21.212009 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 01:09:21.237988 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 01:09:21.799134 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 01:09:21.853072 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:09:21.864642 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 01:09:21.936778 tst mo_mt_call.py: using LAC 24936 01:09:22.063975 tst mo_mt_call.py: using RAC 201 01:09:22.188839 tst mo_mt_call.py: using CellId 24936 01:09:22.314228 tst mo_mt_call.py: using BVCI 24937 01:09:22.430437 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:09:22.442014 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:09:22.453478 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:09:22.464827 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:09:22.476357 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:09:22.487746 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:09:22.601874 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:09:22.720452 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:09:23.219427 run create_hlr_db(pid=6645): Launched 01:09:23.352364 bus /sierra_2: Setting Powered False 01:09:24.416725 run create_hlr_db(pid=6645): Terminated: ok {rc=0} 01:09:24.845603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6647): Launched 01:09:25.148935 run osmo-hlr_10.42.42.2(pid=6648): Launched 01:09:25.264641 run osmo-stp_10.42.42.5: Starting osmo-stp 01:09:25.798993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6650): Launched 01:09:26.100373 run osmo-stp_10.42.42.5(pid=6651): Launched 01:09:26.215865 run osmo-msc_10.42.42.6: Starting osmo-msc 01:09:26.761268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6653): Launched 01:09:27.063998 run osmo-msc_10.42.42.6(pid=6654): Launched 01:09:27.233557 run osmo-stp_10.42.42.5(pid=6651): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6651)] 01:09:27.361170 run osmo-stp_10.42.42.5(pid=6651): stdout: | (launched: 2022-12-10_01:09:26.045188) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:09:27.488795 run osmo-stp_10.42.42.5(pid=6651): stderr: | 20221210010926216 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010926216 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010926216 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010926217 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010926217 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010926217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010926218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:09:27.614207 run osmo-stp_10.42.42.5(pid=6651): stdout: | (launched: 2022-12-10_01:09:26.045188) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:09:27.734696 run osmo-stp_10.42.42.5(pid=6651): stderr: | 20221210010926216 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010926216 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010926216 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010926217 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010926217 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010926217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010926218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:09:27.878801 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6651): Process ended prematurely: osmo-stp_10.42.42.5(pid=6651) [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6651)] [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 01:09:27.888068 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:09:27.914773 run osmo-hlr_10.42.42.2(pid=6648): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6648)] 01:09:27.962588 run osmo-hlr_10.42.42.2(pid=6648): stdout: | (launched: 2022-12-10_01:09:25.092852) 01:09:28.011707 run osmo-hlr_10.42.42.2(pid=6648): stderr: | 20221210010925270 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010925270 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010925270 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010925270 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010925270 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010925270 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010925282 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010925293 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010925293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010925293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:09:28.080375 run osmo-msc_10.42.42.6(pid=6654): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6654)] 01:09:28.127853 run osmo-msc_10.42.42.6(pid=6654): stdout: | (launched: 2022-12-10_01:09:27.008073) 01:09:28.176914 run osmo-msc_10.42.42.6(pid=6654): stderr: | 20221210010927280 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210010927280 DLGLOBAL DEBUG validating counter group 0x7f15675e1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210010927280 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210010927280 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210010927280 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210010927280 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210010927282 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210010927283 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210010927283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210010927283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:09:28.226548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6647): Terminating (SIGTERM) 01:09:28.266335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6650): Terminating (SIGTERM) 01:09:28.306380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6653): Terminating (SIGTERM) 01:09:28.346472 --- ParallelTerminationStrategy: PID 6647 died... 01:09:28.365567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6647): Terminated: ok {rc=0} 01:09:28.409682 --- ParallelTerminationStrategy: PID 6650 died... 01:09:28.428077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6650): Terminated: ok {rc=0} 01:09:28.472190 --- ParallelTerminationStrategy: PID 6653 died... 01:09:28.490738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6653): Terminated: ok {rc=0} 01:09:28.575492 bus /sierra_3: Setting Powered False 01:09:29.673748 bus /sierra_3: Setting Powered False 01:09:30.788910 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 01:09:31.946323 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:09:31.959295 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 01:09:32.031305 tst mo_mt_call_osmux.py: using LAC 24937 01:09:32.151529 tst mo_mt_call_osmux.py: using RAC 202 01:09:32.271791 tst mo_mt_call_osmux.py: using CellId 24937 01:09:32.391670 tst mo_mt_call_osmux.py: using BVCI 24938 01:09:32.510037 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:09:32.521709 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:09:32.533091 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:09:32.544627 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:09:32.556241 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:09:32.567652 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:09:32.681974 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:09:32.802729 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:09:33.300823 run create_hlr_db(pid=6656): Launched 01:09:33.426449 bus /sierra_2: Setting Powered False 01:09:34.486558 run create_hlr_db(pid=6656): Terminated: ok {rc=0} 01:09:34.924356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6658): Launched 01:09:35.246208 run osmo-hlr_10.42.42.2(pid=6659): Launched 01:09:35.369672 run osmo-stp_10.42.42.5: Starting osmo-stp 01:09:35.926850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6661): Launched 01:09:36.249692 run osmo-stp_10.42.42.5(pid=6662): Launched 01:09:36.373818 run osmo-msc_10.42.42.6: Starting osmo-msc 01:09:36.957890 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6664): Launched 01:09:37.281766 run osmo-msc_10.42.42.6(pid=6665): Launched 01:09:37.462405 run osmo-stp_10.42.42.5(pid=6662): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6662)] 01:09:37.598314 run osmo-stp_10.42.42.5(pid=6662): stdout: | (launched: 2022-12-10_01:09:36.190706) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:09:37.734239 run osmo-stp_10.42.42.5(pid=6662): stderr: | 20221210010936384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010936384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010936384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010936385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010936385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010936385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010936385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:09:37.869065 run osmo-stp_10.42.42.5(pid=6662): stdout: | (launched: 2022-12-10_01:09:36.190706) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:09:37.998063 run osmo-stp_10.42.42.5(pid=6662): stderr: | 20221210010936384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010936384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010936384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010936385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010936385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010936385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010936385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:09:38.151374 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6662): Process ended prematurely: osmo-stp_10.42.42.5(pid=6662) [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6662)] [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 01:09:38.160840 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 01:09:38.188538 run osmo-hlr_10.42.42.2(pid=6659): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6659)] 01:09:38.238014 run osmo-hlr_10.42.42.2(pid=6659): stdout: | (launched: 2022-12-10_01:09:35.187152) 01:09:38.289419 run osmo-hlr_10.42.42.2(pid=6659): stderr: | 20221210010935384 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010935384 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010935384 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010935384 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010935384 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010935384 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010935397 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010935405 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010935405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010935405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:09:38.361160 run osmo-msc_10.42.42.6(pid=6665): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6665)] 01:09:38.410539 run osmo-msc_10.42.42.6(pid=6665): stdout: | (launched: 2022-12-10_01:09:37.222393) 01:09:38.461575 run osmo-msc_10.42.42.6(pid=6665): stderr: | 20221210010937545 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210010937546 DLGLOBAL DEBUG validating counter group 0x7fd659fc8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210010937546 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210010937546 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210010937546 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210010937546 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210010937548 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210010937548 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210010937548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210010937548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:09:38.512918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6658): Terminating (SIGTERM) 01:09:38.554206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6661): Terminating (SIGTERM) 01:09:38.595114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6664): Terminating (SIGTERM) 01:09:38.636383 --- ParallelTerminationStrategy: PID 6658 died... 01:09:38.656165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6658): Terminated: ok {rc=0} 01:09:38.702028 --- ParallelTerminationStrategy: PID 6661 died... 01:09:38.721314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6661): Terminated: ok {rc=0} 01:09:38.766606 --- ParallelTerminationStrategy: PID 6664 died... 01:09:38.786038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6664): Terminated: ok {rc=0} 01:09:38.872364 bus /sierra_3: Setting Powered False 01:09:39.970842 bus /sierra_3: Setting Powered False 01:09:41.083603 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 01:09:42.339322 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:09:42.346423 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 01:09:42.381054 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 01:09:42.408380 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 01:09:42.461225 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 01:09:42.495324 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 01:09:42.522282 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 01:09:43.076048 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 01:09:43.127525 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:09:43.139272 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:09:43.210667 tst mo_mt_call.py: using LAC 24938 01:09:43.338393 tst mo_mt_call.py: using RAC 203 01:09:43.465795 tst mo_mt_call.py: using CellId 24938 01:09:43.591415 tst mo_mt_call.py: using BVCI 24939 01:09:43.707308 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:09:43.718896 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:09:43.730331 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:09:43.741861 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:09:43.753406 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:09:43.764716 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:09:43.880254 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:09:43.999484 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:09:44.498971 run create_hlr_db(pid=6670): Launched 01:09:44.630037 bus /sierra_2: Setting Powered False 01:09:45.693519 run create_hlr_db(pid=6670): Terminated: ok {rc=0} 01:09:46.195779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6672): Launched 01:09:46.522142 run osmo-hlr_10.42.42.2(pid=6673): Launched 01:09:46.790599 run osmo-stp_10.42.42.5: Starting osmo-stp 01:09:47.486963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6675): Launched 01:09:47.790387 run osmo-stp_10.42.42.5(pid=6676): Launched 01:09:47.906363 run osmo-msc_10.42.42.6: Starting osmo-msc 01:09:48.452058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6678): Launched 01:09:48.754491 run osmo-msc_10.42.42.6(pid=6679): Launched 01:09:48.939072 run osmo-stp_10.42.42.5(pid=6676): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6676)] 01:09:49.076411 run osmo-stp_10.42.42.5(pid=6676): stdout: | (launched: 2022-12-10_01:09:47.734622) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:09:49.213956 run osmo-stp_10.42.42.5(pid=6676): stderr: | 20221210010947905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010947905 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010947905 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010947906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010947906 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010947906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010947906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:09:49.349040 run osmo-stp_10.42.42.5(pid=6676): stdout: | (launched: 2022-12-10_01:09:47.734622) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:09:49.477333 run osmo-stp_10.42.42.5(pid=6676): stderr: | 20221210010947905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010947905 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010947905 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010947906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010947906 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010947906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010947906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:09:49.631070 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6676): Process ended prematurely: osmo-stp_10.42.42.5(pid=6676) [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6676)] [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 01:09:49.640319 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 01:09:49.667959 run osmo-hlr_10.42.42.2(pid=6673): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6673)] 01:09:49.717875 run osmo-hlr_10.42.42.2(pid=6673): stdout: | (launched: 2022-12-10_01:09:46.461736) 01:09:49.769432 run osmo-hlr_10.42.42.2(pid=6673): stderr: | 20221210010946728 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010946729 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010946729 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010946729 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010946729 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010946729 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010946749 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010946764 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010946764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010946764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:09:49.841289 run osmo-msc_10.42.42.6(pid=6679): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6679)] 01:09:49.891101 run osmo-msc_10.42.42.6(pid=6679): stdout: | (launched: 2022-12-10_01:09:48.698508) 01:09:49.942505 run osmo-msc_10.42.42.6(pid=6679): stderr: | 20221210010949015 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210010949015 DLGLOBAL DEBUG validating counter group 0x7ff50db4ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210010949015 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210010949015 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210010949015 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210010949016 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210010949017 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210010949018 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210010949018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210010949018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:09:49.993999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6672): Terminating (SIGTERM) 01:09:50.035487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6675): Terminating (SIGTERM) 01:09:50.077113 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6678): Terminating (SIGTERM) 01:09:50.118498 --- ParallelTerminationStrategy: PID 6672 died... 01:09:50.138307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6672): Terminated: ok {rc=0} 01:09:50.184038 --- ParallelTerminationStrategy: PID 6675 died... 01:09:50.203627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6675): Terminated: ok {rc=0} 01:09:50.249294 --- ParallelTerminationStrategy: PID 6678 died... 01:09:50.269224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6678): Terminated: ok {rc=0} 01:09:50.355553 bus /sierra_3: Setting Powered False 01:09:51.454289 bus /sierra_3: Setting Powered False 01:09:52.570858 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 01:09:53.721404 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:09:53.733768 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:09:53.805428 tst mo_mt_call_osmux.py: using LAC 24939 01:09:53.932700 tst mo_mt_call_osmux.py: using RAC 204 01:09:54.058210 tst mo_mt_call_osmux.py: using CellId 24939 01:09:54.183738 tst mo_mt_call_osmux.py: using BVCI 24940 01:09:54.300025 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:09:54.311624 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:09:54.323108 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:09:54.335028 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:09:54.346690 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:09:54.358134 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:09:54.476656 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:09:54.593751 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:09:55.061960 run create_hlr_db(pid=6681): Launched 01:09:55.179528 bus /sierra_2: Setting Powered False 01:09:56.239632 run create_hlr_db(pid=6681): Terminated: ok {rc=0} 01:09:56.680457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6683): Launched 01:09:57.003001 run osmo-hlr_10.42.42.2(pid=6684): Launched 01:09:57.126781 run osmo-stp_10.42.42.5: Starting osmo-stp 01:09:57.686063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6686): Launched 01:09:58.009022 run osmo-stp_10.42.42.5(pid=6687): Launched 01:09:58.134818 run osmo-msc_10.42.42.6: Starting osmo-msc 01:09:58.719330 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6689): Launched 01:09:59.042735 run osmo-msc_10.42.42.6(pid=6690): Launched 01:09:59.223609 run osmo-stp_10.42.42.5(pid=6687): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6687)] 01:09:59.359964 run osmo-stp_10.42.42.5(pid=6687): stdout: | (launched: 2022-12-10_01:09:57.950642) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:09:59.496084 run osmo-stp_10.42.42.5(pid=6687): stderr: | 20221210010958143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010958143 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010958143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010958143 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010958144 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010958144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010958144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:09:59.631448 run osmo-stp_10.42.42.5(pid=6687): stdout: | (launched: 2022-12-10_01:09:57.950642) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:09:59.759936 run osmo-stp_10.42.42.5(pid=6687): stderr: | 20221210010958143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210010958143 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210010958143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210010958143 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210010958144 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210010958144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210010958144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:09:59.913755 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6687): Process ended prematurely: osmo-stp_10.42.42.5(pid=6687) [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6687)] [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 01:09:59.923353 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 01:09:59.951007 run osmo-hlr_10.42.42.2(pid=6684): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6684)] 01:10:00.000826 run osmo-hlr_10.42.42.2(pid=6684): stdout: | (launched: 2022-12-10_01:09:56.944184) 01:10:00.052152 run osmo-hlr_10.42.42.2(pid=6684): stderr: | 20221210010957144 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210010957144 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210010957144 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210010957144 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210010957144 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210010957144 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210010957156 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210010957164 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210010957165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210010957165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:10:00.123935 run osmo-msc_10.42.42.6(pid=6690): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6690)] 01:10:00.173616 run osmo-msc_10.42.42.6(pid=6690): stdout: | (launched: 2022-12-10_01:09:58.983465) 01:10:00.224752 run osmo-msc_10.42.42.6(pid=6690): stderr: | 20221210010959304 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210010959305 DLGLOBAL DEBUG validating counter group 0x7fa0bfc03c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210010959305 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210010959305 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210010959305 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210010959305 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210010959307 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210010959307 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210010959307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210010959307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:10:00.276235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6683): Terminating (SIGTERM) 01:10:00.317744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6686): Terminating (SIGTERM) 01:10:00.359863 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6689): Terminating (SIGTERM) 01:10:00.401771 --- ParallelTerminationStrategy: PID 6683 died... 01:10:00.421566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6683): Terminated: ok {rc=0} 01:10:00.467523 --- ParallelTerminationStrategy: PID 6686 died... 01:10:00.486908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6686): Terminated: ok {rc=0} 01:10:00.533353 --- ParallelTerminationStrategy: PID 6689 died... 01:10:00.552694 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6689): Terminated: ok {rc=0} 01:10:00.640894 bus /sierra_3: Setting Powered False 01:10:01.738157 bus /sierra_3: Setting Powered False 01:10:02.855299 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:10:04.111249 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:10:04.117915 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:10:04.154465 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 01:10:04.181474 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:10:04.235353 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:10:04.269864 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 01:10:04.296701 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:10:04.849043 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 01:10:04.900407 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:04.912429 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:10:04.984469 tst mo_mt_call.py: using LAC 24940 01:10:05.111630 tst mo_mt_call.py: using RAC 205 01:10:05.230715 tst mo_mt_call.py: using CellId 24940 01:10:05.348302 tst mo_mt_call.py: using BVCI 24941 01:10:05.458888 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:05.470316 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:05.481582 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:05.493241 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:05.504821 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:05.516326 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:10:05.638728 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:10:05.757383 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:10:06.256527 run create_hlr_db(pid=6706): Launched 01:10:06.389328 bus /sierra_2: Setting Powered False 01:10:07.453109 run create_hlr_db(pid=6706): Terminated: ok {rc=0} 01:10:07.882446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6708): Launched 01:10:08.186497 run osmo-hlr_10.42.42.2(pid=6709): Launched 01:10:08.304203 run osmo-stp_10.42.42.5: Starting osmo-stp 01:10:08.836029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6711): Launched 01:10:09.137721 run osmo-stp_10.42.42.5(pid=6712): Launched 01:10:09.254389 run osmo-msc_10.42.42.6: Starting osmo-msc 01:10:09.801634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6714): Launched 01:10:10.104908 run osmo-msc_10.42.42.6(pid=6715): Launched 01:10:10.275719 run osmo-stp_10.42.42.5(pid=6712): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6712)] 01:10:10.404305 run osmo-stp_10.42.42.5(pid=6712): stdout: | (launched: 2022-12-10_01:10:09.082230) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:10:10.532249 run osmo-stp_10.42.42.5(pid=6712): stderr: | 20221210011009252 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011009252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011009252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011009253 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011009255 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011009255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011009255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:10:10.657425 run osmo-stp_10.42.42.5(pid=6712): stdout: | (launched: 2022-12-10_01:10:09.082230) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:10:10.777454 run osmo-stp_10.42.42.5(pid=6712): stderr: | 20221210011009252 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011009252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011009252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011009253 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011009255 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011009255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011009255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:10:10.921108 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6712): Process ended prematurely: osmo-stp_10.42.42.5(pid=6712) [trial-2367↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6712)] [trial-2367↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 01:10:10.930166 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:10:10.956662 run osmo-hlr_10.42.42.2(pid=6709): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6709)] 01:10:11.004485 run osmo-hlr_10.42.42.2(pid=6709): stdout: | (launched: 2022-12-10_01:10:08.131485) 01:10:11.053934 run osmo-hlr_10.42.42.2(pid=6709): stderr: | 20221210011008305 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011008305 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011008305 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011008306 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011008306 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011008306 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011008319 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011008329 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011008329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011008329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:10:11.122680 run osmo-msc_10.42.42.6(pid=6715): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6715)] 01:10:11.169923 run osmo-msc_10.42.42.6(pid=6715): stdout: | (launched: 2022-12-10_01:10:10.049216) 01:10:11.218676 run osmo-msc_10.42.42.6(pid=6715): stderr: | 20221210011010323 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210011010323 DLGLOBAL DEBUG validating counter group 0x7fe34f13ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210011010323 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210011010323 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210011010324 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210011010324 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210011010326 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210011010326 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210011010327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210011010327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:10:11.268010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6708): Terminating (SIGTERM) 01:10:11.307543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6711): Terminating (SIGTERM) 01:10:11.347192 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6714): Terminating (SIGTERM) 01:10:11.386791 --- ParallelTerminationStrategy: PID 6708 died... 01:10:11.405750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6708): Terminated: ok {rc=0} 01:10:11.450015 --- ParallelTerminationStrategy: PID 6711 died... 01:10:11.468429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6711): Terminated: ok {rc=0} 01:10:11.512123 --- ParallelTerminationStrategy: PID 6714 died... 01:10:11.530520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6714): Terminated: ok {rc=0} 01:10:11.615841 bus /sierra_3: Setting Powered False 01:10:12.714229 bus /sierra_3: Setting Powered False 01:10:13.833757 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 01:10:14.988657 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:15.001075 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:10:15.073513 tst mo_mt_call_osmux.py: using LAC 24941 01:10:15.201365 tst mo_mt_call_osmux.py: using RAC 206 01:10:15.327511 tst mo_mt_call_osmux.py: using CellId 24941 01:10:15.454806 tst mo_mt_call_osmux.py: using BVCI 24942 01:10:15.571760 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:15.583695 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:15.595358 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:15.607174 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:15.618776 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:15.630483 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:10:15.747814 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:10:15.872911 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:10:16.395675 run create_hlr_db(pid=6894): Launched 01:10:16.554963 bus /sierra_2: Setting Powered False 01:10:17.614593 run create_hlr_db(pid=6894): Terminated: ok {rc=0} 01:10:18.035861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6896): Launched 01:10:18.338787 run osmo-hlr_10.42.42.2(pid=6897): Launched 01:10:18.454935 run osmo-stp_10.42.42.5: Starting osmo-stp 01:10:18.986885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6899): Launched 01:10:19.288034 run osmo-stp_10.42.42.5(pid=6900): Launched 01:10:19.404120 run osmo-msc_10.42.42.6: Starting osmo-msc 01:10:19.949599 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6902): Launched 01:10:20.252699 run osmo-msc_10.42.42.6(pid=6903): Launched 01:10:20.423710 run osmo-stp_10.42.42.5(pid=6900): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6900)] 01:10:20.551371 run osmo-stp_10.42.42.5(pid=6900): stdout: | (launched: 2022-12-10_01:10:19.232685) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:10:20.679028 run osmo-stp_10.42.42.5(pid=6900): stderr: | 20221210011019405 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011019405 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011019405 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011019406 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011019406 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011019406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011019406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:10:20.804066 run osmo-stp_10.42.42.5(pid=6900): stdout: | (launched: 2022-12-10_01:10:19.232685) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:10:20.924122 run osmo-stp_10.42.42.5(pid=6900): stderr: | 20221210011019405 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011019405 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011019405 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011019406 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011019406 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011019406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011019406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:10:21.068163 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6900): Process ended prematurely: osmo-stp_10.42.42.5(pid=6900) [trial-2367↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6900)] [trial-2367↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 01:10:21.077257 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 01:10:21.104335 run osmo-hlr_10.42.42.2(pid=6897): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6897)] 01:10:21.151541 run osmo-hlr_10.42.42.2(pid=6897): stdout: | (launched: 2022-12-10_01:10:18.282945) 01:10:21.200598 run osmo-hlr_10.42.42.2(pid=6897): stderr: | 20221210011018460 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011018460 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011018460 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011018460 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011018460 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011018460 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011018472 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011018482 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011018482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011018482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:10:21.268542 run osmo-msc_10.42.42.6(pid=6903): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6903)] 01:10:21.315794 run osmo-msc_10.42.42.6(pid=6903): stdout: | (launched: 2022-12-10_01:10:20.197410) 01:10:21.364664 run osmo-msc_10.42.42.6(pid=6903): stderr: | 20221210011020470 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210011020470 DLGLOBAL DEBUG validating counter group 0x7f4c10b89c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210011020470 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210011020470 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210011020470 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210011020470 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210011020472 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210011020473 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210011020473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210011020473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:10:21.413925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6896): Terminating (SIGTERM) 01:10:21.453373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6899): Terminating (SIGTERM) 01:10:21.492719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6902): Terminating (SIGTERM) 01:10:21.532314 --- ParallelTerminationStrategy: PID 6896 died... 01:10:21.551267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6896): Terminated: ok {rc=0} 01:10:21.595156 --- ParallelTerminationStrategy: PID 6899 died... 01:10:21.613528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6899): Terminated: ok {rc=0} 01:10:21.657221 --- ParallelTerminationStrategy: PID 6902 died... 01:10:21.675548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6902): Terminated: ok {rc=0} 01:10:21.758289 bus /sierra_3: Setting Powered False 01:10:22.856574 bus /sierra_3: Setting Powered False 01:10:23.980713 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 01:10:25.245121 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:10:25.252113 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 01:10:25.288572 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 01:10:25.316799 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 01:10:25.370607 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 01:10:25.406067 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 01:10:25.434444 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 01:10:25.985943 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 01:10:26.040779 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:10:26.053536 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:10:26.126105 tst mo_mt_call.py: using LAC 24942 01:10:26.254168 tst mo_mt_call.py: using RAC 207 01:10:26.384426 tst mo_mt_call.py: using CellId 24942 01:10:26.511922 tst mo_mt_call.py: using BVCI 24943 01:10:26.632288 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:10:26.644907 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:10:26.657148 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:10:26.670252 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:10:26.682585 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:10:26.694926 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:10:26.819541 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:10:26.942067 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:10:27.452673 run create_hlr_db(pid=7257): Launched 01:10:27.621547 bus /sierra_2: Setting Powered False 01:10:28.688189 run create_hlr_db(pid=7257): Terminated: ok {rc=0} 01:10:29.149842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7259): Launched 01:10:29.495171 run osmo-hlr_10.42.42.2(pid=7261): Launched 01:10:29.654820 run osmo-stp_10.42.42.5: Starting osmo-stp 01:10:30.188067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7263): Launched 01:10:30.493727 run osmo-stp_10.42.42.5(pid=7264): Launched 01:10:30.612797 run osmo-msc_10.42.42.6: Starting osmo-msc 01:10:31.199572 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7266): Launched 01:10:31.584620 run osmo-msc_10.42.42.6(pid=7267): Launched 01:10:31.880860 run osmo-stp_10.42.42.5(pid=7264): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7264)] 01:10:32.148855 run osmo-stp_10.42.42.5(pid=7264): stdout: | (launched: 2022-12-10_01:10:30.437807) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:10:32.395669 run osmo-stp_10.42.42.5(pid=7264): stderr: | 20221210011030608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011030609 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011030609 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011030609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011030610 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011030610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011030610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:10:32.544100 run osmo-stp_10.42.42.5(pid=7264): stdout: | (launched: 2022-12-10_01:10:30.437807) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:10:32.666106 run osmo-stp_10.42.42.5(pid=7264): stderr: | 20221210011030608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011030609 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011030609 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011030609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011030610 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011030610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011030610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:10:32.812064 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7264): Process ended prematurely: osmo-stp_10.42.42.5(pid=7264) [trial-2367↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7264)] [trial-2367↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 01:10:32.821268 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 01:10:32.848310 run osmo-hlr_10.42.42.2(pid=7261): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7261)] 01:10:32.896495 run osmo-hlr_10.42.42.2(pid=7261): stdout: | (launched: 2022-12-10_01:10:29.435179) 01:10:32.946053 run osmo-hlr_10.42.42.2(pid=7261): stderr: | 20221210011029664 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011029664 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011029664 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011029664 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011029664 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011029664 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011029677 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011029685 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011029685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011029685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:10:33.015098 run osmo-msc_10.42.42.6(pid=7267): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7267)] 01:10:33.063078 run osmo-msc_10.42.42.6(pid=7267): stdout: | (launched: 2022-12-10_01:10:31.501007) 01:10:33.112714 run osmo-msc_10.42.42.6(pid=7267): stderr: | 20221210011032190 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210011032190 DLGLOBAL DEBUG validating counter group 0x7f7c7f05bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210011032191 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210011032192 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210011032193 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210011032193 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210011032197 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210011032198 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210011032198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210011032198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:10:33.162788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7259): Terminating (SIGTERM) 01:10:33.202916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7263): Terminating (SIGTERM) 01:10:33.242942 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7266): Terminating (SIGTERM) 01:10:33.283164 --- ParallelTerminationStrategy: PID 7259 died... 01:10:33.302364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7259): Terminated: ok {rc=0} 01:10:33.346875 --- ParallelTerminationStrategy: PID 7263 died... 01:10:33.365352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7263): Terminated: ok {rc=0} 01:10:33.409741 --- ParallelTerminationStrategy: PID 7266 died... 01:10:33.428411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7266): Terminated: ok {rc=0} 01:10:33.514954 bus /sierra_3: Setting Powered False 01:10:34.614611 bus /sierra_3: Setting Powered False 01:10:35.728471 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 01:10:36.879253 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:10:36.891786 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:10:36.967498 tst mo_mt_call_osmux.py: using LAC 24943 01:10:37.096275 tst mo_mt_call_osmux.py: using RAC 208 01:10:37.224236 tst mo_mt_call_osmux.py: using CellId 24943 01:10:37.351487 tst mo_mt_call_osmux.py: using BVCI 24944 01:10:37.470280 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:10:37.482195 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:10:37.493679 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:10:37.505665 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:10:37.517713 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:10:37.529614 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:10:37.649961 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:10:37.771063 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:10:38.242871 run create_hlr_db(pid=7269): Launched 01:10:38.359949 bus /sierra_2: Setting Powered False 01:10:39.424862 run create_hlr_db(pid=7269): Terminated: ok {rc=0} 01:10:39.876921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7271): Launched 01:10:40.202277 run osmo-hlr_10.42.42.2(pid=7272): Launched 01:10:40.328239 run osmo-stp_10.42.42.5: Starting osmo-stp 01:10:40.890648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7274): Launched 01:10:41.215545 run osmo-stp_10.42.42.5(pid=7275): Launched 01:10:41.339407 run osmo-msc_10.42.42.6: Starting osmo-msc 01:10:41.929868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7277): Launched 01:10:42.255335 run osmo-msc_10.42.42.6(pid=7278): Launched 01:10:42.438244 run osmo-stp_10.42.42.5(pid=7275): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7275)] 01:10:42.575605 run osmo-stp_10.42.42.5(pid=7275): stdout: | (launched: 2022-12-10_01:10:41.156156) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:10:42.712293 run osmo-stp_10.42.42.5(pid=7275): stderr: | 20221210011041347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011041347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011041347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011041348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011041348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011041348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011041348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:10:42.848506 run osmo-stp_10.42.42.5(pid=7275): stdout: | (launched: 2022-12-10_01:10:41.156156) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:10:42.978140 run osmo-stp_10.42.42.5(pid=7275): stderr: | 20221210011041347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011041347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011041347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011041348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011041348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011041348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011041348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:10:43.133396 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7275): Process ended prematurely: osmo-stp_10.42.42.5(pid=7275) [trial-2367↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7275)] [trial-2367↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 01:10:43.143169 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 01:10:43.171342 run osmo-hlr_10.42.42.2(pid=7272): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7272)] 01:10:43.221619 run osmo-hlr_10.42.42.2(pid=7272): stdout: | (launched: 2022-12-10_01:10:40.143359) 01:10:43.273555 run osmo-hlr_10.42.42.2(pid=7272): stderr: | 20221210011040340 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011040340 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011040340 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011040340 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011040340 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011040341 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011040354 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011040363 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011040363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011040363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:10:43.346025 run osmo-msc_10.42.42.6(pid=7278): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7278)] 01:10:43.396478 run osmo-msc_10.42.42.6(pid=7278): stdout: | (launched: 2022-12-10_01:10:42.196041) 01:10:43.448247 run osmo-msc_10.42.42.6(pid=7278): stderr: | 20221210011042518 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210011042519 DLGLOBAL DEBUG validating counter group 0x7f6f4b641c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210011042519 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210011042519 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210011042519 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210011042519 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210011042521 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210011042521 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210011042522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210011042522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:10:43.500357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7271): Terminating (SIGTERM) 01:10:43.542186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7274): Terminating (SIGTERM) 01:10:43.584121 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7277): Terminating (SIGTERM) 01:10:43.626194 --- ParallelTerminationStrategy: PID 7271 died... 01:10:43.646185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7271): Terminated: ok {rc=0} 01:10:43.692599 --- ParallelTerminationStrategy: PID 7274 died... 01:10:43.712290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7274): Terminated: ok {rc=0} 01:10:43.758607 --- ParallelTerminationStrategy: PID 7277 died... 01:10:43.778314 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7277): Terminated: ok {rc=0} 01:10:43.865494 bus /sierra_3: Setting Powered False 01:10:44.964474 bus /sierra_3: Setting Powered False 01:10:46.080120 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 01:10:47.342068 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:10:47.347004 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 01:10:47.380817 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 01:10:47.407192 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 01:10:47.489320 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 01:10:47.522748 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 01:10:47.548910 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 01:10:48.136092 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2367 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 01:10:48.142571 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:10:48.155494 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 01:10:48.209821 tst emergency_mo_mt_call.py: using LAC 24944 01:10:48.334543 tst emergency_mo_mt_call.py: using RAC 209 01:10:48.458522 tst emergency_mo_mt_call.py: using CellId 24944 01:10:48.582529 tst emergency_mo_mt_call.py: using BVCI 24945 01:10:48.697394 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:10:48.708588 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:10:48.719752 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:10:48.730829 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:10:48.741903 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:10:48.752855 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:10:48.872294 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:10:48.986629 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:10:49.448320 run create_hlr_db(pid=7283): Launched 01:10:49.563783 bus /sierra_2: Setting Powered False 01:10:50.622678 run create_hlr_db(pid=7283): Terminated: ok {rc=0} 01:10:51.059350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7285): Launched 01:10:51.380592 run osmo-hlr_10.42.42.2(pid=7286): Launched 01:10:51.503715 run osmo-stp_10.42.42.5: Starting osmo-stp 01:10:52.054066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7288): Launched 01:10:52.375938 run osmo-stp_10.42.42.5(pid=7289): Launched 01:10:52.508363 tst emergency_mo_mt_call.py: using MSISDN 7473 01:10:52.671815 run osmo-msc_10.42.42.6: Starting osmo-msc 01:10:53.247069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7291): Launched 01:10:53.568286 run osmo-msc_10.42.42.6(pid=7292): Launched 01:10:53.748704 run osmo-stp_10.42.42.5(pid=7289): ERR: Terminated: ERROR {rc=1} [trial-2367↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7289)] 01:10:53.883468 run osmo-stp_10.42.42.5(pid=7289): stdout: | (launched: 2022-12-10_01:10:52.316920) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:10:54.018151 run osmo-stp_10.42.42.5(pid=7289): stderr: | 20221210011052509 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011052509 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011052509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011052510 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011052512 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011052512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011052512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:10:54.151723 run osmo-stp_10.42.42.5(pid=7289): stdout: | (launched: 2022-12-10_01:10:52.316920) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:10:54.278411 run osmo-stp_10.42.42.5(pid=7289): stderr: | 20221210011052509 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011052509 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011052509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011052510 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011052512 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011052512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011052512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:10:54.430831 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=7289): Process ended prematurely: osmo-stp_10.42.42.5(pid=7289) [trial-2367↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7289)] [trial-2367↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 01:10:54.439828 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 01:10:54.467522 run osmo-hlr_10.42.42.2(pid=7286): ERR: Terminated: ERROR {rc=237} [trial-2367↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7286)] 01:10:54.518283 run osmo-hlr_10.42.42.2(pid=7286): stdout: | (launched: 2022-12-10_01:10:51.321820) 01:10:54.571082 run osmo-hlr_10.42.42.2(pid=7286): stderr: | 20221210011051518 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011051518 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011051518 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011051518 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011051518 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011051518 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011051531 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011051539 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011051539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011051539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:10:54.644322 run osmo-msc_10.42.42.6(pid=7292): ERR: Terminated: ERROR {rc=2} [trial-2367↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7292)] 01:10:54.694648 run osmo-msc_10.42.42.6(pid=7292): stdout: | (launched: 2022-12-10_01:10:53.509647) 01:10:54.746831 run osmo-msc_10.42.42.6(pid=7292): stderr: | 20221210011053834 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210011053835 DLGLOBAL DEBUG validating counter group 0x7f9cc1933c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210011053835 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210011053835 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210011053835 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210011053835 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210011053837 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210011053838 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210011053838 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210011053838 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:10:54.799364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7285): Terminating (SIGTERM) 01:10:54.841568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7288): Terminating (SIGTERM) 01:10:54.883696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7291): Terminating (SIGTERM) 01:10:54.926059 --- ParallelTerminationStrategy: PID 7285 died... 01:10:54.946162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7285): Terminated: ok {rc=0} 01:10:54.992720 --- ParallelTerminationStrategy: PID 7288 died... 01:10:55.012552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7288): Terminated: ok {rc=0} 01:10:55.059351 --- ParallelTerminationStrategy: PID 7291 died... 01:10:55.079045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7291): Terminated: ok {rc=0} 01:10:55.168904 bus /sierra_3: Setting Powered False 01:10:56.268929 bus /sierra_3: Setting Powered False 01:10:57.385164 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 01:10:58.473702 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:10:58.485844 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 01:10:58.537978 tst emergency_preemptive_call.py: using LAC 24945 01:10:58.662485 tst emergency_preemptive_call.py: using RAC 210 01:10:58.786384 tst emergency_preemptive_call.py: using CellId 24945 01:10:58.911356 tst emergency_preemptive_call.py: using BVCI 24946 01:10:59.026630 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:10:59.037999 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:10:59.049049 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:10:59.060107 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:10:59.071217 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:10:59.082360 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:10:59.200560 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:10:59.317889 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:10:59.435041 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:10:59.553181 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:11:00.016696 run create_hlr_db(pid=7294): Launched 01:11:00.133539 bus /sierra_2: Setting Powered False 01:11:01.191955 run create_hlr_db(pid=7294): Terminated: ok {rc=0} 01:11:01.618993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7296): Launched 01:11:01.946655 run osmo-hlr_10.42.42.2(pid=7297): Launched 01:11:02.181401 run osmo-stp_10.42.42.5: Starting osmo-stp 01:11:02.771091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7299): Launched 01:11:03.092670 run osmo-stp_10.42.42.5(pid=7300): Launched 01:11:03.224814 tst emergency_preemptive_call.py: using MSISDN 7474 01:11:03.388420 run osmo-msc_10.42.42.6: Starting osmo-msc 01:11:03.962903 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7302): Launched 01:11:04.282835 run osmo-msc_10.42.42.6(pid=7303): Launched 01:11:04.462420 run osmo-stp_10.42.42.5(pid=7300): ERR: Terminated: ERROR {rc=1} [trial-2367↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7300)] 01:11:04.597379 run osmo-stp_10.42.42.5(pid=7300): stdout: | (launched: 2022-12-10_01:11:03.034234) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:11:04.733178 run osmo-stp_10.42.42.5(pid=7300): stderr: | 20221210011103228 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011103228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011103229 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011103229 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011103229 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011103230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011103230 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:11:04.867563 run osmo-stp_10.42.42.5(pid=7300): stdout: | (launched: 2022-12-10_01:11:03.034234) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:11:04.994482 run osmo-stp_10.42.42.5(pid=7300): stderr: | 20221210011103228 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011103228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011103229 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011103229 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011103229 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011103230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011103230 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:11:05.147001 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=7300): Process ended prematurely: osmo-stp_10.42.42.5(pid=7300) [trial-2367↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7300)] [trial-2367↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 01:11:05.156041 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 01:11:05.184348 run osmo-hlr_10.42.42.2(pid=7297): ERR: Terminated: ERROR {rc=237} [trial-2367↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7297)] 01:11:05.235225 run osmo-hlr_10.42.42.2(pid=7297): stdout: | (launched: 2022-12-10_01:11:01.881977) 01:11:05.287752 run osmo-hlr_10.42.42.2(pid=7297): stderr: | 20221210011102202 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011102202 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011102202 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011102202 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011102202 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011102203 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011102222 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011102234 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011102234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011102234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:11:05.361489 run osmo-msc_10.42.42.6(pid=7303): ERR: Terminated: ERROR {rc=2} [trial-2367↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7303)] 01:11:05.412112 run osmo-msc_10.42.42.6(pid=7303): stdout: | (launched: 2022-12-10_01:11:04.223964) 01:11:05.464190 run osmo-msc_10.42.42.6(pid=7303): stderr: | 20221210011104546 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210011104546 DLGLOBAL DEBUG validating counter group 0x7f45a2a6ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210011104546 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210011104547 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210011104547 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210011104547 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210011104550 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210011104551 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210011104551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210011104551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:11:05.516845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7296): Terminating (SIGTERM) 01:11:05.559120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7299): Terminating (SIGTERM) 01:11:05.601513 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7302): Terminating (SIGTERM) 01:11:05.643705 --- ParallelTerminationStrategy: PID 7296 died... 01:11:05.663821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7296): Terminated: ok {rc=0} 01:11:05.710502 --- ParallelTerminationStrategy: PID 7299 died... 01:11:05.730130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7299): Terminated: ok {rc=0} 01:11:05.776333 --- ParallelTerminationStrategy: PID 7302 died... 01:11:05.796117 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7302): Terminated: ok {rc=0} 01:11:05.885147 bus /sierra_9: Setting Powered False 01:11:06.983006 bus /sierra_9: Setting Powered False 01:11:08.098776 bus /sierra_8: Setting Powered False 01:11:09.198180 bus /sierra_8: Setting Powered False 01:11:10.314351 bus /sierra_3: Setting Powered False 01:11:11.413490 bus /sierra_3: Setting Powered False 01:11:12.529397 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 01:11:13.818370 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:11:13.823340 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 01:11:13.857948 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 01:11:13.897172 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 01:11:13.987466 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 01:11:14.021627 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 01:11:14.059442 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 01:11:14.652828 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 01:11:14.704798 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:14.715499 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 01:11:14.765408 tst cs_paging_gprs_active.py: using LAC 24946 01:11:14.886740 tst cs_paging_gprs_active.py: using RAC 211 01:11:15.009382 tst cs_paging_gprs_active.py: using CellId 24946 01:11:15.130851 tst cs_paging_gprs_active.py: using BVCI 24947 01:11:15.243320 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:15.254055 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:15.264442 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:15.275186 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:15.286013 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:15.296600 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:15.307454 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:15.318013 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:15.328699 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:11:15.444004 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:11:15.560880 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:11:15.764885 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:11:16.083004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7308): Launched 01:11:16.362783 run iperf3-srv_10.42.42.10(pid=7309): Launched 01:11:16.507730 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:11:16.733929 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:11:17.073074 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7310): Launched 01:11:17.371478 run iperf3-srv_10.42.42.10(pid=7311): Launched 01:11:17.494882 tst cs_paging_gprs_active.py:38: start network... 01:11:17.714269 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:11:18.219750 run create_hlr_db(pid=7312): Launched 01:11:18.352869 bus /sierra_2: Setting Powered False 01:11:19.413931 run create_hlr_db(pid=7312): Terminated: ok {rc=0} 01:11:19.865691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7314): Launched 01:11:20.193640 run osmo-hlr_10.42.42.2(pid=7315): Launched 01:11:20.320798 run osmo-stp_10.42.42.5: Starting osmo-stp 01:11:20.887187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7317): Launched 01:11:21.212803 run osmo-stp_10.42.42.5(pid=7318): Launched 01:11:21.338336 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:11:21.901784 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7320): Launched 01:11:22.030329 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:11:22.288871 run patchelf(pid=7321): Launched 01:11:22.459517 run osmo-stp_10.42.42.5(pid=7318): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7318)] 01:11:22.589095 run osmo-stp_10.42.42.5(pid=7318): stdout: | (launched: 2022-12-10_01:11:21.153620) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:11:22.720024 run osmo-stp_10.42.42.5(pid=7318): stderr: | 20221210011121347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011121347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011121347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011121348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011121350 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011121350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011121350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:11:22.851279 run osmo-stp_10.42.42.5(pid=7318): stdout: | (launched: 2022-12-10_01:11:21.153620) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:11:22.976207 run osmo-stp_10.42.42.5(pid=7318): stderr: | 20221210011121347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011121347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011121347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011121348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011121350 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011121350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011121350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:11:23.124203 run patchelf(pid=7321): Terminating (SIGINT) 01:11:23.295246 run patchelf(pid=7321): Terminated: ok {rc=0} 01:11:23.418400 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7318): Process ended prematurely: osmo-stp_10.42.42.5(pid=7318) [trial-2367↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7318)] [trial-2367↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 01:11:23.427855 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 01:11:23.455673 run osmo-hlr_10.42.42.2(pid=7315): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7315)] 01:11:23.503963 run osmo-hlr_10.42.42.2(pid=7315): stdout: | (launched: 2022-12-10_01:11:20.134092) 01:11:23.553436 run osmo-hlr_10.42.42.2(pid=7315): stderr: | 20221210011120335 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011120335 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011120335 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011120335 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011120335 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011120335 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011120348 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011120359 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011120359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011120359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:11:23.603344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7308): Terminating (SIGTERM) 01:11:23.643296 run iperf3-srv_10.42.42.10(pid=7309): Terminating (SIGTERM) 01:11:23.682895 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7310): Terminating (SIGTERM) 01:11:23.722829 run iperf3-srv_10.42.42.10(pid=7311): Terminating (SIGTERM) 01:11:23.762394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7314): Terminating (SIGTERM) 01:11:23.802117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7317): Terminating (SIGTERM) 01:11:23.842538 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7320): Terminating (SIGTERM) 01:11:23.882687 --- ParallelTerminationStrategy: PID 7308 died... 01:11:23.901652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7308): Terminated: ok {rc=0} 01:11:23.945911 --- ParallelTerminationStrategy: PID 7309 died... 01:11:23.964213 run iperf3-srv_10.42.42.10(pid=7309): Terminated {rc=256} 01:11:24.008574 --- ParallelTerminationStrategy: PID 7310 died... 01:11:24.027155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7310): Terminated: ok {rc=0} 01:11:24.071165 --- ParallelTerminationStrategy: PID 7311 died... 01:11:24.089777 run iperf3-srv_10.42.42.10(pid=7311): Terminated {rc=256} 01:11:24.133701 --- ParallelTerminationStrategy: PID 7314 died... 01:11:24.152226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7314): Terminated: ok {rc=0} 01:11:24.196242 --- ParallelTerminationStrategy: PID 7317 died... 01:11:24.214827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7317): Terminated: ok {rc=0} 01:11:24.258892 --- ParallelTerminationStrategy: PID 7320 died... 01:11:24.277501 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7320): Terminated: ok {rc=0} 01:11:24.362037 bus /gobi_0: Setting Powered False 01:11:25.461384 bus /gobi_0: Setting Powered False 01:11:26.576605 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 01:11:27.725738 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:27.737638 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 01:11:27.793717 tst iperf3.py: using LAC 24947 01:11:27.912844 tst iperf3.py: using RAC 212 01:11:28.032916 tst iperf3.py: using CellId 24947 01:11:28.151882 tst iperf3.py: using BVCI 24948 01:11:28.261568 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:28.272167 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:28.282672 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:28.293376 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:28.304071 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:28.314836 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:28.325798 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:28.336289 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:28.347174 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:11:28.461288 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:11:28.664656 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:11:28.969472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7322): Launched 01:11:29.235772 run iperf3-srv_10.42.42.10(pid=7323): Launched 01:11:29.350748 tst iperf3.py:8: start network... 01:11:29.554049 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:11:30.025596 run create_hlr_db(pid=7324): Launched 01:11:30.160419 bus /gobi_6: Setting Powered False 01:11:31.233646 run create_hlr_db(pid=7324): Terminated: ok {rc=0} 01:11:31.697913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7326): Launched 01:11:32.050154 run osmo-hlr_10.42.42.2(pid=7327): Launched 01:11:32.275267 run osmo-stp_10.42.42.5: Starting osmo-stp 01:11:32.804624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7329): Launched 01:11:33.111394 run osmo-stp_10.42.42.5(pid=7330): Launched 01:11:33.228601 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:11:33.755244 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7332): Launched 01:11:33.874240 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:11:34.131941 run patchelf(pid=7333): Launched 01:11:34.302192 run osmo-stp_10.42.42.5(pid=7330): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7330)] 01:11:34.431325 run osmo-stp_10.42.42.5(pid=7330): stdout: | (launched: 2022-12-10_01:11:33.055315) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:11:34.562112 run osmo-stp_10.42.42.5(pid=7330): stderr: | 20221210011133227 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011133228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011133228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011133228 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011133229 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011133229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011133229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:11:34.692543 run osmo-stp_10.42.42.5(pid=7330): stdout: | (launched: 2022-12-10_01:11:33.055315) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:11:34.817989 run osmo-stp_10.42.42.5(pid=7330): stderr: | 20221210011133227 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011133228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011133228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011133228 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011133229 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011133229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011133229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:11:34.966798 run patchelf(pid=7333): Terminating (SIGINT) 01:11:35.137140 run patchelf(pid=7333): Terminated: ok {rc=0} 01:11:35.259953 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7330): Process ended prematurely: osmo-stp_10.42.42.5(pid=7330) [trial-2367↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7330)] [trial-2367↪gprs:trx-sysmocell5000↪iperf3.py:8] 01:11:35.269677 tst iperf3.py:8: Test FAILED (7.6 sec) 01:11:35.297377 run osmo-hlr_10.42.42.2(pid=7327): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7327)] 01:11:35.345298 run osmo-hlr_10.42.42.2(pid=7327): stdout: | (launched: 2022-12-10_01:11:31.989147) 01:11:35.394758 run osmo-hlr_10.42.42.2(pid=7327): stderr: | 20221210011132282 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011132282 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011132282 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011132282 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011132282 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011132282 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011132322 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011132332 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011132332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011132332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:11:35.444869 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7322): Terminating (SIGTERM) 01:11:35.484932 run iperf3-srv_10.42.42.10(pid=7323): Terminating (SIGTERM) 01:11:35.524596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7326): Terminating (SIGTERM) 01:11:35.564454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7329): Terminating (SIGTERM) 01:11:35.604348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7332): Terminating (SIGTERM) 01:11:35.644260 --- ParallelTerminationStrategy: PID 7322 died... 01:11:35.663251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7322): Terminated: ok {rc=0} 01:11:35.707298 --- ParallelTerminationStrategy: PID 7323 died... 01:11:35.725770 run iperf3-srv_10.42.42.10(pid=7323): Terminated {rc=256} 01:11:35.769613 --- ParallelTerminationStrategy: PID 7326 died... 01:11:35.788063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7326): Terminated: ok {rc=0} 01:11:35.832126 --- ParallelTerminationStrategy: PID 7329 died... 01:11:35.850684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7329): Terminated: ok {rc=0} 01:11:35.894739 --- ParallelTerminationStrategy: PID 7332 died... 01:11:35.913327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7332): Terminated: ok {rc=0} 01:11:35.999341 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 01:11:37.146656 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:37.158221 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 01:11:37.208921 tst iperf3m4.py: using LAC 24948 01:11:37.333276 tst iperf3m4.py: using RAC 213 01:11:37.461606 tst iperf3m4.py: using CellId 24948 01:11:37.589504 tst iperf3m4.py: using BVCI 24949 01:11:37.701240 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:37.712093 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:37.722620 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:37.733483 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:37.744145 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:37.754857 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:37.765774 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:37.776388 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:37.787320 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:11:37.903247 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:11:38.025159 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:11:38.142434 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:11:38.262691 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:11:38.482278 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:11:38.807704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7334): Launched 01:11:39.091929 run iperf3-srv_10.42.42.10(pid=7335): Launched 01:11:39.215291 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:11:39.434997 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:11:39.761565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7336): Launched 01:11:40.046509 run iperf3-srv_10.42.42.10(pid=7337): Launched 01:11:40.170695 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:11:40.390070 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:11:40.716824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7338): Launched 01:11:40.999795 run iperf3-srv_10.42.42.10(pid=7339): Launched 01:11:41.123881 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:11:41.342438 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:11:41.669877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7340): Launched 01:11:41.953822 run iperf3-srv_10.42.42.10(pid=7341): Launched 01:11:42.078415 tst iperf3m4.py:8: start network... 01:11:42.298361 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:11:42.808501 run create_hlr_db(pid=7342): Launched 01:11:42.940597 bus /gobi_6: Setting Powered False 01:11:44.001322 run create_hlr_db(pid=7342): Terminated: ok {rc=0} 01:11:44.435261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7344): Launched 01:11:44.741297 run osmo-hlr_10.42.42.2(pid=7345): Launched 01:11:44.860224 run osmo-stp_10.42.42.5: Starting osmo-stp 01:11:45.391446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7347): Launched 01:11:45.699159 run osmo-stp_10.42.42.5(pid=7348): Launched 01:11:45.816093 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:11:46.510821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7350): Launched 01:11:46.650817 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:11:46.936387 run patchelf(pid=7351): Launched 01:11:47.137649 run osmo-stp_10.42.42.5(pid=7348): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7348)] 01:11:47.277064 run osmo-stp_10.42.42.5(pid=7348): stdout: | (launched: 2022-12-10_01:11:45.642849) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:11:47.417040 run osmo-stp_10.42.42.5(pid=7348): stderr: | 20221210011145816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011145816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011145817 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011145817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011145817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011145817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011145818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:11:47.556637 run osmo-stp_10.42.42.5(pid=7348): stdout: | (launched: 2022-12-10_01:11:45.642849) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:11:47.690643 run osmo-stp_10.42.42.5(pid=7348): stderr: | 20221210011145816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011145816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011145817 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011145817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011145817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011145817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011145818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:11:47.849203 run patchelf(pid=7351): Terminating (SIGINT) 01:11:48.030976 run patchelf(pid=7351): Terminated: ok {rc=0} 01:11:48.162015 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7348): Process ended prematurely: osmo-stp_10.42.42.5(pid=7348) [trial-2367↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7348)] [trial-2367↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 01:11:48.172256 tst iperf3m4.py:8: Test FAILED (11.1 sec) 01:11:48.201357 run osmo-hlr_10.42.42.2(pid=7345): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7345)] 01:11:48.251901 run osmo-hlr_10.42.42.2(pid=7345): stdout: | (launched: 2022-12-10_01:11:44.685046) 01:11:48.304649 run osmo-hlr_10.42.42.2(pid=7345): stderr: | 20221210011144862 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011144862 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011144862 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011144862 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011144862 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011144862 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011144875 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011144885 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011144885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011144885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:11:48.357461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7334): Terminating (SIGTERM) 01:11:48.400267 run iperf3-srv_10.42.42.10(pid=7335): Terminating (SIGTERM) 01:11:48.442480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7336): Terminating (SIGTERM) 01:11:48.484734 run iperf3-srv_10.42.42.10(pid=7337): Terminating (SIGTERM) 01:11:48.527260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7338): Terminating (SIGTERM) 01:11:48.569317 run iperf3-srv_10.42.42.10(pid=7339): Terminating (SIGTERM) 01:11:48.611252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7340): Terminating (SIGTERM) 01:11:48.653403 run iperf3-srv_10.42.42.10(pid=7341): Terminating (SIGTERM) 01:11:48.695225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7344): Terminating (SIGTERM) 01:11:48.737770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7347): Terminating (SIGTERM) 01:11:48.780119 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7350): Terminating (SIGTERM) 01:11:48.822581 --- ParallelTerminationStrategy: PID 7334 died... 01:11:48.842663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7334): Terminated: ok {rc=0} 01:11:48.889461 --- ParallelTerminationStrategy: PID 7335 died... 01:11:48.909182 run iperf3-srv_10.42.42.10(pid=7335): Terminated {rc=256} 01:11:48.955588 --- ParallelTerminationStrategy: PID 7336 died... 01:11:48.975736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7336): Terminated: ok {rc=0} 01:11:49.022623 --- ParallelTerminationStrategy: PID 7337 died... 01:11:49.042441 run iperf3-srv_10.42.42.10(pid=7337): Terminated {rc=256} 01:11:49.089014 --- ParallelTerminationStrategy: PID 7338 died... 01:11:49.108927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7338): Terminated: ok {rc=0} 01:11:49.155818 --- ParallelTerminationStrategy: PID 7339 died... 01:11:49.175606 run iperf3-srv_10.42.42.10(pid=7339): Terminated {rc=256} 01:11:49.222336 --- ParallelTerminationStrategy: PID 7340 died... 01:11:49.242211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7340): Terminated: ok {rc=0} 01:11:49.288906 --- ParallelTerminationStrategy: PID 7341 died... 01:11:49.308806 run iperf3-srv_10.42.42.10(pid=7341): Terminated {rc=256} 01:11:49.355564 --- ParallelTerminationStrategy: PID 7344 died... 01:11:49.375762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7344): Terminated: ok {rc=0} 01:11:49.422994 --- ParallelTerminationStrategy: PID 7347 died... 01:11:49.442974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7347): Terminated: ok {rc=0} 01:11:49.489482 --- ParallelTerminationStrategy: PID 7350 died... 01:11:49.509200 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7350): Terminated: ok {rc=0} 01:11:49.598677 bus /gobi_4: Setting Powered False 01:11:50.699350 bus /gobi_4: Setting Powered False 01:11:51.816103 bus /gobi_1: Setting Powered False 01:11:52.916830 bus /gobi_1: Setting Powered False 01:11:54.036613 bus /gobi_0: Setting Powered False 01:11:55.136740 bus /gobi_0: Setting Powered False 01:11:56.251666 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 01:11:57.354923 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:57.366774 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 01:11:57.417910 tst ping.py: using LAC 24949 01:11:57.545039 tst ping.py: using RAC 214 01:11:57.671423 tst ping.py: using CellId 24949 01:11:57.799324 tst ping.py: using BVCI 24950 01:11:57.916516 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:57.927696 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:57.938783 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:57.949807 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:57.960788 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:57.971747 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:57.982901 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:57.993969 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:11:58.112246 tst ping.py:19: start network... 01:11:58.326010 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:11:58.819032 run create_hlr_db(pid=7352): Launched 01:11:58.951009 bus /gobi_6: Setting Powered False 01:12:00.010544 run create_hlr_db(pid=7352): Terminated: ok {rc=0} 01:12:00.455455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7354): Launched 01:12:00.774924 run osmo-hlr_10.42.42.2(pid=7355): Launched 01:12:00.898467 run osmo-stp_10.42.42.5: Starting osmo-stp 01:12:01.614487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7357): Launched 01:12:01.937501 run osmo-stp_10.42.42.5(pid=7358): Launched 01:12:02.299267 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:12:02.855000 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7360): Launched 01:12:02.978722 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:12:03.247902 run patchelf(pid=7361): Launched 01:12:03.426175 run osmo-stp_10.42.42.5(pid=7358): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7358)] 01:12:03.561366 run osmo-stp_10.42.42.5(pid=7358): stdout: | (launched: 2022-12-10_01:12:01.879919) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:12:03.698318 run osmo-stp_10.42.42.5(pid=7358): stderr: | 20221210011202155 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011202155 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011202156 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011202156 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011202157 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011202157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011202157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:12:03.835129 run osmo-stp_10.42.42.5(pid=7358): stdout: | (launched: 2022-12-10_01:12:01.879919) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:12:03.966907 run osmo-stp_10.42.42.5(pid=7358): stderr: | 20221210011202155 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011202155 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011202156 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011202156 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011202157 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011202157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011202157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:12:04.122342 run patchelf(pid=7361): Terminating (SIGINT) 01:12:04.300147 run patchelf(pid=7361): Terminated: ok {rc=0} 01:12:04.429073 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7358): Process ended prematurely: osmo-stp_10.42.42.5(pid=7358) [trial-2367↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7358)] [trial-2367↪gprs:trx-sysmocell5000↪ping.py:22] 01:12:04.438741 tst ping.py:22: Test FAILED (7.1 sec) 01:12:04.467194 run osmo-hlr_10.42.42.2(pid=7355): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7355)] 01:12:04.517737 run osmo-hlr_10.42.42.2(pid=7355): stdout: | (launched: 2022-12-10_01:12:00.716519) 01:12:04.570212 run osmo-hlr_10.42.42.2(pid=7355): stderr: | 20221210011200991 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011200991 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011200991 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011200991 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011200991 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011200991 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011201014 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011201029 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011201030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011201030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:12:04.623294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7354): Terminating (SIGTERM) 01:12:04.665790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7357): Terminating (SIGTERM) 01:12:04.708187 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7360): Terminating (SIGTERM) 01:12:04.750877 --- ParallelTerminationStrategy: PID 7354 died... 01:12:04.771021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7354): Terminated: ok {rc=0} 01:12:04.817607 --- ParallelTerminationStrategy: PID 7357 died... 01:12:04.837489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7357): Terminated: ok {rc=0} 01:12:04.883807 --- ParallelTerminationStrategy: PID 7360 died... 01:12:04.903558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7360): Terminated: ok {rc=0} 01:12:04.991696 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 01:12:06.081783 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:06.094304 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 01:12:06.146344 tst ping_idle_ping.py: using LAC 24950 01:12:06.272886 tst ping_idle_ping.py: using RAC 215 01:12:06.398482 tst ping_idle_ping.py: using CellId 24950 01:12:06.523227 tst ping_idle_ping.py: using BVCI 24951 01:12:06.639662 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:06.651007 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:06.662120 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:06.673713 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:06.684564 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:06.695572 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:06.707297 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:06.718327 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:12:06.836086 tst ping_idle_ping.py:24: start network... 01:12:07.050312 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:12:07.548743 run create_hlr_db(pid=7362): Launched 01:12:07.679356 bus /gobi_6: Setting Powered False 01:12:08.742701 run create_hlr_db(pid=7362): Terminated: ok {rc=0} 01:12:09.171773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7364): Launched 01:12:09.473740 run osmo-hlr_10.42.42.2(pid=7365): Launched 01:12:09.590637 run osmo-stp_10.42.42.5: Starting osmo-stp 01:12:10.123896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7367): Launched 01:12:10.424499 run osmo-stp_10.42.42.5(pid=7368): Launched 01:12:10.540090 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:12:11.057473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7370): Launched 01:12:11.173445 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:12:11.427268 run patchelf(pid=7371): Launched 01:12:11.594736 run osmo-stp_10.42.42.5(pid=7368): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7368)] 01:12:11.721415 run osmo-stp_10.42.42.5(pid=7368): stdout: | (launched: 2022-12-10_01:12:10.368859) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:12:11.849447 run osmo-stp_10.42.42.5(pid=7368): stderr: | 20221210011210540 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011210540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011210540 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011210540 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011210541 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011210541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011210541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:12:11.977730 run osmo-stp_10.42.42.5(pid=7368): stdout: | (launched: 2022-12-10_01:12:10.368859) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:12:12.100614 run osmo-stp_10.42.42.5(pid=7368): stderr: | 20221210011210540 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011210540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011210540 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011210540 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011210541 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011210541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011210541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:12:12.246484 run patchelf(pid=7371): Terminating (SIGINT) 01:12:12.414415 run patchelf(pid=7371): Terminated: ok {rc=0} 01:12:12.535255 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7368): Process ended prematurely: osmo-stp_10.42.42.5(pid=7368) [trial-2367↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7368)] [trial-2367↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 01:12:12.544191 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 01:12:12.571693 run osmo-hlr_10.42.42.2(pid=7365): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7365)] 01:12:12.619626 run osmo-hlr_10.42.42.2(pid=7365): stdout: | (launched: 2022-12-10_01:12:09.418597) 01:12:12.669214 run osmo-hlr_10.42.42.2(pid=7365): stderr: | 20221210011209594 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011209594 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011209594 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011209594 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011209594 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011209594 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011209606 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011209615 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011209615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011209615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:12:12.719267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7364): Terminating (SIGTERM) 01:12:12.759298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7367): Terminating (SIGTERM) 01:12:12.799165 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7370): Terminating (SIGTERM) 01:12:12.839196 --- ParallelTerminationStrategy: PID 7364 died... 01:12:12.858622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7364): Terminated: ok {rc=0} 01:12:12.902747 --- ParallelTerminationStrategy: PID 7367 died... 01:12:12.921289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7367): Terminated: ok {rc=0} 01:12:12.965891 --- ParallelTerminationStrategy: PID 7370 died... 01:12:12.984575 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7370): Terminated: ok {rc=0} 01:12:13.071347 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 01:12:14.389432 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:12:14.395555 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 01:12:14.429752 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 01:12:14.468794 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 01:12:14.557107 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 01:12:14.591264 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 01:12:14.630041 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 01:12:15.227370 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 01:12:15.279379 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:15.290684 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:12:15.342999 tst cs_paging_gprs_active.py: using LAC 24951 01:12:15.471646 tst cs_paging_gprs_active.py: using RAC 216 01:12:15.600735 tst cs_paging_gprs_active.py: using CellId 24951 01:12:15.728476 tst cs_paging_gprs_active.py: using BVCI 24952 01:12:15.849151 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:15.861347 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:15.875754 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:15.887505 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:15.900354 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:15.914579 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:15.926536 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:15.938178 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:15.950164 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:12:16.079033 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:12:16.223164 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:12:16.435140 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:12:16.752125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7377): Launched 01:12:17.039572 run iperf3-srv_10.42.42.10(pid=7378): Launched 01:12:17.174876 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:12:17.386910 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:12:17.695603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7379): Launched 01:12:17.962380 run iperf3-srv_10.42.42.10(pid=7380): Launched 01:12:18.079773 tst cs_paging_gprs_active.py:38: start network... 01:12:18.283838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:12:18.757757 run create_hlr_db(pid=7381): Launched 01:12:18.892238 bus /gobi_6: Setting Powered False 01:12:19.956001 run create_hlr_db(pid=7381): Terminated: ok {rc=0} 01:12:20.391839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7383): Launched 01:12:20.699745 run osmo-hlr_10.42.42.2(pid=7384): Launched 01:12:20.817835 run osmo-stp_10.42.42.5: Starting osmo-stp 01:12:21.359611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7386): Launched 01:12:21.667317 run osmo-stp_10.42.42.5(pid=7387): Launched 01:12:21.784398 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:12:22.311935 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7389): Launched 01:12:22.430137 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:12:22.688646 run patchelf(pid=7390): Launched 01:12:22.859355 run osmo-stp_10.42.42.5(pid=7387): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7387)] 01:12:22.988428 run osmo-stp_10.42.42.5(pid=7387): stdout: | (launched: 2022-12-10_01:12:21.611047) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:12:23.119020 run osmo-stp_10.42.42.5(pid=7387): stderr: | 20221210011221782 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011221782 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011221783 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011221783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011221783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011221784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011221784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:12:23.249930 run osmo-stp_10.42.42.5(pid=7387): stdout: | (launched: 2022-12-10_01:12:21.611047) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:12:23.375262 run osmo-stp_10.42.42.5(pid=7387): stderr: | 20221210011221782 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011221782 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011221783 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011221783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011221783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011221784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011221784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:12:23.523658 run patchelf(pid=7390): Terminating (SIGINT) 01:12:23.694222 run patchelf(pid=7390): Terminated: ok {rc=0} 01:12:23.817535 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7387): Process ended prematurely: osmo-stp_10.42.42.5(pid=7387) [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7387)] [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 01:12:23.827090 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 01:12:23.854716 run osmo-hlr_10.42.42.2(pid=7384): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7384)] 01:12:23.902260 run osmo-hlr_10.42.42.2(pid=7384): stdout: | (launched: 2022-12-10_01:12:20.643527) 01:12:23.951634 run osmo-hlr_10.42.42.2(pid=7384): stderr: | 20221210011220823 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011220823 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011220823 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011220824 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011220824 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011220824 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011220836 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011220845 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011220845 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011220845 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:12:24.001716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7377): Terminating (SIGTERM) 01:12:24.041803 run iperf3-srv_10.42.42.10(pid=7378): Terminating (SIGTERM) 01:12:24.081530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7379): Terminating (SIGTERM) 01:12:24.121442 run iperf3-srv_10.42.42.10(pid=7380): Terminating (SIGTERM) 01:12:24.161076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7383): Terminating (SIGTERM) 01:12:24.200841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7386): Terminating (SIGTERM) 01:12:24.240721 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7389): Terminating (SIGTERM) 01:12:24.280840 --- ParallelTerminationStrategy: PID 7377 died... 01:12:24.299876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7377): Terminated: ok {rc=0} 01:12:24.343994 --- ParallelTerminationStrategy: PID 7378 died... 01:12:24.362392 run iperf3-srv_10.42.42.10(pid=7378): Terminated {rc=256} 01:12:24.406457 --- ParallelTerminationStrategy: PID 7379 died... 01:12:24.424707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7379): Terminated: ok {rc=0} 01:12:24.468717 --- ParallelTerminationStrategy: PID 7380 died... 01:12:24.487138 run iperf3-srv_10.42.42.10(pid=7380): Terminated {rc=256} 01:12:24.530962 --- ParallelTerminationStrategy: PID 7383 died... 01:12:24.549372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7383): Terminated: ok {rc=0} 01:12:24.593206 --- ParallelTerminationStrategy: PID 7386 died... 01:12:24.611683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7386): Terminated: ok {rc=0} 01:12:24.655649 --- ParallelTerminationStrategy: PID 7389 died... 01:12:24.674236 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7389): Terminated: ok {rc=0} 01:12:24.760675 bus /gobi_0: Setting Powered False 01:12:25.860322 bus /gobi_0: Setting Powered False 01:12:26.975185 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 01:12:28.121135 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:28.132756 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:12:28.186995 tst iperf3.py: using LAC 24952 01:12:28.313357 tst iperf3.py: using RAC 217 01:12:28.433183 tst iperf3.py: using CellId 24952 01:12:28.550727 tst iperf3.py: using BVCI 24953 01:12:28.662702 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:28.674144 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:28.684775 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:28.695732 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:28.706678 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:28.717670 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:28.728703 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:28.739524 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:28.750565 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:12:28.864803 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:12:29.070384 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:12:29.377048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7391): Launched 01:12:29.643483 run iperf3-srv_10.42.42.10(pid=7392): Launched 01:12:29.758626 tst iperf3.py:8: start network... 01:12:29.962374 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:12:30.434885 run create_hlr_db(pid=7393): Launched 01:12:30.553777 bus /gobi_6: Setting Powered False 01:12:31.639667 run create_hlr_db(pid=7393): Terminated: ok {rc=0} 01:12:32.144810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7395): Launched 01:12:32.477817 run osmo-hlr_10.42.42.2(pid=7396): Launched 01:12:32.603337 run osmo-stp_10.42.42.5: Starting osmo-stp 01:12:33.166655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7398): Launched 01:12:33.493987 run osmo-stp_10.42.42.5(pid=7399): Launched 01:12:33.622463 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:12:34.185476 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7401): Launched 01:12:34.310731 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:12:34.587320 run patchelf(pid=7402): Launched 01:12:34.768169 run osmo-stp_10.42.42.5(pid=7399): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7399)] 01:12:34.905282 run osmo-stp_10.42.42.5(pid=7399): stdout: | (launched: 2022-12-10_01:12:33.434199) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:12:35.043824 run osmo-stp_10.42.42.5(pid=7399): stderr: | 20221210011233628 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011233628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011233629 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011233629 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011233629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011233629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011233630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:12:35.182821 run osmo-stp_10.42.42.5(pid=7399): stdout: | (launched: 2022-12-10_01:12:33.434199) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:12:35.316373 run osmo-stp_10.42.42.5(pid=7399): stderr: | 20221210011233628 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011233628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011233629 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011233629 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011233629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011233629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011233630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:12:35.475707 run patchelf(pid=7402): Terminating (SIGINT) 01:12:35.656657 run patchelf(pid=7402): Terminated: ok {rc=0} 01:12:35.787248 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7399): Process ended prematurely: osmo-stp_10.42.42.5(pid=7399) [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7399)] [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 01:12:35.797463 tst iperf3.py:8: Test FAILED (7.7 sec) 01:12:35.826269 run osmo-hlr_10.42.42.2(pid=7396): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7396)] 01:12:35.876194 run osmo-hlr_10.42.42.2(pid=7396): stdout: | (launched: 2022-12-10_01:12:32.417896) 01:12:35.927852 run osmo-hlr_10.42.42.2(pid=7396): stderr: | 20221210011232619 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011232619 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011232619 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011232619 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011232619 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011232620 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011232632 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011232640 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011232640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011232641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:12:35.979827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7391): Terminating (SIGTERM) 01:12:36.021900 run iperf3-srv_10.42.42.10(pid=7392): Terminating (SIGTERM) 01:12:36.063802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7395): Terminating (SIGTERM) 01:12:36.105495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7398): Terminating (SIGTERM) 01:12:36.147377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7401): Terminating (SIGTERM) 01:12:36.189389 --- ParallelTerminationStrategy: PID 7391 died... 01:12:36.209247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7391): Terminated: ok {rc=0} 01:12:36.255346 --- ParallelTerminationStrategy: PID 7392 died... 01:12:36.274837 run iperf3-srv_10.42.42.10(pid=7392): Terminated {rc=256} 01:12:36.320885 --- ParallelTerminationStrategy: PID 7395 died... 01:12:36.340521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7395): Terminated: ok {rc=0} 01:12:36.386706 --- ParallelTerminationStrategy: PID 7398 died... 01:12:36.406698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7398): Terminated: ok {rc=0} 01:12:36.453055 --- ParallelTerminationStrategy: PID 7401 died... 01:12:36.472739 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7401): Terminated: ok {rc=0} 01:12:36.561492 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 01:12:37.709449 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:37.721192 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:12:37.772701 tst iperf3m4.py: using LAC 24953 01:12:37.893272 tst iperf3m4.py: using RAC 218 01:12:38.017666 tst iperf3m4.py: using CellId 24953 01:12:38.146275 tst iperf3m4.py: using BVCI 24954 01:12:38.258765 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:38.269996 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:38.280913 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:38.291913 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:38.303119 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:38.314344 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:38.325632 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:38.336380 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:38.347633 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:12:38.464143 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:12:38.583668 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:12:38.705277 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:12:38.823503 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:12:39.028357 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:12:39.345535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7408): Launched 01:12:39.613555 run iperf3-srv_10.42.42.10(pid=7409): Launched 01:12:39.729720 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:12:39.935405 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:12:40.244120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7410): Launched 01:12:40.510440 run iperf3-srv_10.42.42.10(pid=7411): Launched 01:12:40.627717 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:12:40.832434 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:12:41.139169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7412): Launched 01:12:41.407268 run iperf3-srv_10.42.42.10(pid=7413): Launched 01:12:41.522972 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:12:41.728201 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:12:42.035715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7414): Launched 01:12:42.302211 run iperf3-srv_10.42.42.10(pid=7415): Launched 01:12:42.419725 tst iperf3m4.py:8: start network... 01:12:42.623783 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:12:43.097241 run create_hlr_db(pid=7416): Launched 01:12:43.214072 bus /gobi_6: Setting Powered False 01:12:44.274963 run create_hlr_db(pid=7416): Terminated: ok {rc=0} 01:12:44.699888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7418): Launched 01:12:45.006782 run osmo-hlr_10.42.42.2(pid=7419): Launched 01:12:45.124374 run osmo-stp_10.42.42.5: Starting osmo-stp 01:12:45.669845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7421): Launched 01:12:46.021538 run osmo-stp_10.42.42.5(pid=7422): Launched 01:12:46.304152 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:12:46.904199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7424): Launched 01:12:47.037131 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:12:47.300903 run patchelf(pid=7425): Launched 01:12:47.482782 run osmo-stp_10.42.42.5(pid=7422): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7422)] 01:12:47.612156 run osmo-stp_10.42.42.5(pid=7422): stdout: | (launched: 2022-12-10_01:12:45.961513) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:12:47.743108 run osmo-stp_10.42.42.5(pid=7422): stderr: | 20221210011246300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011246301 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011246301 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011246301 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011246302 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011246302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011246302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:12:47.874167 run osmo-stp_10.42.42.5(pid=7422): stdout: | (launched: 2022-12-10_01:12:45.961513) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:12:47.999254 run osmo-stp_10.42.42.5(pid=7422): stderr: | 20221210011246300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011246301 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011246301 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011246301 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011246302 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011246302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011246302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:12:48.147766 run patchelf(pid=7425): Terminating (SIGINT) 01:12:48.319655 run patchelf(pid=7425): Terminated: ok {rc=0} 01:12:48.443334 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7422): Process ended prematurely: osmo-stp_10.42.42.5(pid=7422) [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7422)] [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 01:12:48.453186 tst iperf3m4.py:8: Test FAILED (10.8 sec) 01:12:48.481724 run osmo-hlr_10.42.42.2(pid=7419): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7419)] 01:12:48.529620 run osmo-hlr_10.42.42.2(pid=7419): stdout: | (launched: 2022-12-10_01:12:44.950535) 01:12:48.579424 run osmo-hlr_10.42.42.2(pid=7419): stderr: | 20221210011245127 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011245127 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011245128 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011245128 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011245128 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011245128 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011245140 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011245148 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011245148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011245148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:12:48.629877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7408): Terminating (SIGTERM) 01:12:48.670239 run iperf3-srv_10.42.42.10(pid=7409): Terminating (SIGTERM) 01:12:48.710468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7410): Terminating (SIGTERM) 01:12:48.750729 run iperf3-srv_10.42.42.10(pid=7411): Terminating (SIGTERM) 01:12:48.790797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7412): Terminating (SIGTERM) 01:12:48.830965 run iperf3-srv_10.42.42.10(pid=7413): Terminating (SIGTERM) 01:12:48.871137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7414): Terminating (SIGTERM) 01:12:48.911302 run iperf3-srv_10.42.42.10(pid=7415): Terminating (SIGTERM) 01:12:48.951421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7418): Terminating (SIGTERM) 01:12:48.991850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7421): Terminating (SIGTERM) 01:12:49.032320 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7424): Terminating (SIGTERM) 01:12:49.073878 --- ParallelTerminationStrategy: PID 7408 died... 01:12:49.093260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7408): Terminated: ok {rc=0} 01:12:49.138474 --- ParallelTerminationStrategy: PID 7409 died... 01:12:49.157397 run iperf3-srv_10.42.42.10(pid=7409): Terminated {rc=256} 01:12:49.202797 --- ParallelTerminationStrategy: PID 7410 died... 01:12:49.221645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7410): Terminated: ok {rc=0} 01:12:49.266065 --- ParallelTerminationStrategy: PID 7411 died... 01:12:49.284583 run iperf3-srv_10.42.42.10(pid=7411): Terminated {rc=256} 01:12:49.328705 --- ParallelTerminationStrategy: PID 7412 died... 01:12:49.347716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7412): Terminated: ok {rc=0} 01:12:49.391992 --- ParallelTerminationStrategy: PID 7413 died... 01:12:49.410734 run iperf3-srv_10.42.42.10(pid=7413): Terminated {rc=256} 01:12:49.455694 --- ParallelTerminationStrategy: PID 7414 died... 01:12:49.474790 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7414): Terminated: ok {rc=0} 01:12:49.519332 --- ParallelTerminationStrategy: PID 7415 died... 01:12:49.538168 run iperf3-srv_10.42.42.10(pid=7415): Terminated {rc=256} 01:12:49.582632 --- ParallelTerminationStrategy: PID 7418 died... 01:12:49.601477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7418): Terminated: ok {rc=0} 01:12:49.646144 --- ParallelTerminationStrategy: PID 7421 died... 01:12:49.664892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7421): Terminated: ok {rc=0} 01:12:49.709614 --- ParallelTerminationStrategy: PID 7424 died... 01:12:49.728548 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7424): Terminated: ok {rc=0} 01:12:49.814470 bus /gobi_4: Setting Powered False 01:12:50.915305 bus /gobi_4: Setting Powered False 01:12:52.031411 bus /gobi_1: Setting Powered False 01:12:53.129444 bus /gobi_1: Setting Powered False 01:12:54.243801 bus /gobi_0: Setting Powered False 01:12:55.341770 bus /gobi_0: Setting Powered False 01:12:56.459032 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 01:12:57.563510 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:57.575534 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:12:57.627977 tst ping.py: using LAC 24954 01:12:57.746312 tst ping.py: using RAC 219 01:12:57.864685 tst ping.py: using CellId 24954 01:12:57.981652 tst ping.py: using BVCI 24955 01:12:58.100780 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:58.112460 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:58.123823 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:58.135711 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:58.148579 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:58.160465 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:58.171844 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:58.182796 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:12:58.302430 tst ping.py:19: start network... 01:12:58.518128 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:12:59.013021 run create_hlr_db(pid=7426): Launched 01:12:59.143461 bus /gobi_6: Setting Powered False 01:13:00.207017 run create_hlr_db(pid=7426): Terminated: ok {rc=0} 01:13:00.634513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7428): Launched 01:13:00.950832 run osmo-hlr_10.42.42.2(pid=7429): Launched 01:13:01.166744 run osmo-stp_10.42.42.5: Starting osmo-stp 01:13:01.832722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7431): Launched 01:13:02.171127 run osmo-stp_10.42.42.5(pid=7432): Launched 01:13:02.361101 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:13:02.922086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7434): Launched 01:13:03.046203 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:13:03.316189 run patchelf(pid=7435): Launched 01:13:03.495739 run osmo-stp_10.42.42.5(pid=7432): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7432)] 01:13:03.632193 run osmo-stp_10.42.42.5(pid=7432): stdout: | (launched: 2022-12-10_01:13:02.112070) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:13:03.769846 run osmo-stp_10.42.42.5(pid=7432): stderr: | 20221210011302374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011302375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011302375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011302375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011302376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011302376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011302376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:13:03.907182 run osmo-stp_10.42.42.5(pid=7432): stdout: | (launched: 2022-12-10_01:13:02.112070) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:13:04.039196 run osmo-stp_10.42.42.5(pid=7432): stderr: | 20221210011302374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011302375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011302375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011302375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011302376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011302376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011302376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:13:04.195664 run patchelf(pid=7435): Terminating (SIGINT) 01:13:04.374533 run patchelf(pid=7435): Terminated: ok {rc=0} 01:13:04.503684 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7432): Process ended prematurely: osmo-stp_10.42.42.5(pid=7432) [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7432)] [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 01:13:04.513322 tst ping.py:22: Test FAILED (6.9 sec) 01:13:04.541781 run osmo-hlr_10.42.42.2(pid=7429): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7429)] 01:13:04.592038 run osmo-hlr_10.42.42.2(pid=7429): stdout: | (launched: 2022-12-10_01:13:00.890492) 01:13:04.644204 run osmo-hlr_10.42.42.2(pid=7429): stderr: | 20221210011301259 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011301259 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011301259 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011301259 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011301259 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011301259 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011301285 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011301309 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011301309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011301309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:13:04.697103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7428): Terminating (SIGTERM) 01:13:04.739319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7431): Terminating (SIGTERM) 01:13:04.781718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7434): Terminating (SIGTERM) 01:13:04.824114 --- ParallelTerminationStrategy: PID 7428 died... 01:13:04.844401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7428): Terminated: ok {rc=0} 01:13:04.891111 --- ParallelTerminationStrategy: PID 7431 died... 01:13:04.911011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7431): Terminated: ok {rc=0} 01:13:04.957867 --- ParallelTerminationStrategy: PID 7434 died... 01:13:04.977838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7434): Terminated: ok {rc=0} 01:13:05.066449 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 01:13:06.156060 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:06.167990 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:13:06.222320 tst ping_idle_ping.py: using LAC 24955 01:13:06.342120 tst ping_idle_ping.py: using RAC 220 01:13:06.462247 tst ping_idle_ping.py: using CellId 24955 01:13:06.581949 tst ping_idle_ping.py: using BVCI 24956 01:13:06.693326 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:06.704449 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:06.715626 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:06.727077 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:06.740346 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:06.752445 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:06.764231 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:06.775853 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:13:06.892720 tst ping_idle_ping.py:24: start network... 01:13:07.094407 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:13:07.562224 run create_hlr_db(pid=7436): Launched 01:13:07.680345 bus /gobi_6: Setting Powered False 01:13:08.741459 run create_hlr_db(pid=7436): Terminated: ok {rc=0} 01:13:09.181446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7438): Launched 01:13:09.506405 run osmo-hlr_10.42.42.2(pid=7439): Launched 01:13:09.632509 run osmo-stp_10.42.42.5: Starting osmo-stp 01:13:10.191029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7441): Launched 01:13:10.514304 run osmo-stp_10.42.42.5(pid=7442): Launched 01:13:10.637854 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:13:11.192468 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7444): Launched 01:13:11.315621 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:13:11.587565 run patchelf(pid=7445): Launched 01:13:11.769367 run osmo-stp_10.42.42.5(pid=7442): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7442)] 01:13:11.905319 run osmo-stp_10.42.42.5(pid=7442): stdout: | (launched: 2022-12-10_01:13:10.455259) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:13:12.042422 run osmo-stp_10.42.42.5(pid=7442): stderr: | 20221210011310649 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011310649 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011310650 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011310650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011310650 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011310651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011310651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:13:12.179520 run osmo-stp_10.42.42.5(pid=7442): stdout: | (launched: 2022-12-10_01:13:10.455259) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:13:12.311434 run osmo-stp_10.42.42.5(pid=7442): stderr: | 20221210011310649 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011310649 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011310650 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011310650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011310650 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011310651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011310651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:13:12.467632 run patchelf(pid=7445): Terminating (SIGINT) 01:13:12.646572 run patchelf(pid=7445): Terminated: ok {rc=0} 01:13:12.775516 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7442): Process ended prematurely: osmo-stp_10.42.42.5(pid=7442) [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7442)] [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 01:13:12.785056 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 01:13:12.813159 run osmo-hlr_10.42.42.2(pid=7439): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7439)] 01:13:12.862854 run osmo-hlr_10.42.42.2(pid=7439): stdout: | (launched: 2022-12-10_01:13:09.447384) 01:13:12.914288 run osmo-hlr_10.42.42.2(pid=7439): stderr: | 20221210011309645 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011309645 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011309645 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011309645 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011309645 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011309645 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011309658 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011309666 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011309667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011309667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:13:12.966125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7438): Terminating (SIGTERM) 01:13:13.007827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7441): Terminating (SIGTERM) 01:13:13.049506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7444): Terminating (SIGTERM) 01:13:13.091391 --- ParallelTerminationStrategy: PID 7438 died... 01:13:13.111355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7438): Terminated: ok {rc=0} 01:13:13.157395 --- ParallelTerminationStrategy: PID 7441 died... 01:13:13.176903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7441): Terminated: ok {rc=0} 01:13:13.223009 --- ParallelTerminationStrategy: PID 7444 died... 01:13:13.242621 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7444): Terminated: ok {rc=0} 01:13:13.330064 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 01:13:14.647164 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:13:14.654008 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 01:13:14.688308 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 01:13:14.727436 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 01:13:14.816301 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 01:13:14.850743 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 01:13:14.889732 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 01:13:15.489636 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 01:13:15.541735 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:15.553074 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:13:15.628387 tst cs_paging_gprs_active.py: using LAC 24956 01:13:15.755941 tst cs_paging_gprs_active.py: using RAC 221 01:13:15.891031 tst cs_paging_gprs_active.py: using CellId 24956 01:13:16.017367 tst cs_paging_gprs_active.py: using BVCI 24957 01:13:16.139765 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:16.151686 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:16.164092 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:16.176380 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:16.189383 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:16.202504 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:16.215543 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:16.227730 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:16.240393 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:13:16.362830 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:13:16.513847 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:13:16.746342 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:13:17.112802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7449): Launched 01:13:17.410307 run iperf3-srv_10.42.42.10(pid=7450): Launched 01:13:17.535353 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:13:17.755669 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:13:18.083392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7451): Launched 01:13:18.368748 run iperf3-srv_10.42.42.10(pid=7452): Launched 01:13:18.491856 tst cs_paging_gprs_active.py:38: start network... 01:13:18.711144 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:13:19.217126 run create_hlr_db(pid=7453): Launched 01:13:19.352045 bus /gobi_6: Setting Powered False 01:13:20.415743 run create_hlr_db(pid=7453): Terminated: ok {rc=0} 01:13:20.852564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7455): Launched 01:13:21.158715 run osmo-hlr_10.42.42.2(pid=7456): Launched 01:13:21.275969 run osmo-stp_10.42.42.5: Starting osmo-stp 01:13:21.819950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7458): Launched 01:13:22.126713 run osmo-stp_10.42.42.5(pid=7459): Launched 01:13:22.246648 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:13:22.773079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7461): Launched 01:13:22.890490 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:13:23.148174 run patchelf(pid=7462): Launched 01:13:23.319237 run osmo-stp_10.42.42.5(pid=7459): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7459)] 01:13:23.448692 run osmo-stp_10.42.42.5(pid=7459): stdout: | (launched: 2022-12-10_01:13:22.070521) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:13:23.579590 run osmo-stp_10.42.42.5(pid=7459): stderr: | 20221210011322243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011322243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011322243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011322243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011322244 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011322244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011322244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:13:23.710591 run osmo-stp_10.42.42.5(pid=7459): stdout: | (launched: 2022-12-10_01:13:22.070521) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:13:23.836262 run osmo-stp_10.42.42.5(pid=7459): stderr: | 20221210011322243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011322243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011322243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011322243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011322244 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011322244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011322244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:13:23.984470 run patchelf(pid=7462): Terminating (SIGINT) 01:13:24.154800 run patchelf(pid=7462): Terminated: ok {rc=0} 01:13:24.277651 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7459): Process ended prematurely: osmo-stp_10.42.42.5(pid=7459) [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7459)] [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 01:13:24.287181 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 01:13:24.315049 run osmo-hlr_10.42.42.2(pid=7456): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7456)] 01:13:24.363029 run osmo-hlr_10.42.42.2(pid=7456): stdout: | (launched: 2022-12-10_01:13:21.102856) 01:13:24.412602 run osmo-hlr_10.42.42.2(pid=7456): stderr: | 20221210011321280 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011321280 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011321280 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011321280 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011321280 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011321280 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011321292 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011321301 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011321301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011321301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:13:24.462763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7449): Terminating (SIGTERM) 01:13:24.502854 run iperf3-srv_10.42.42.10(pid=7450): Terminating (SIGTERM) 01:13:24.542716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7451): Terminating (SIGTERM) 01:13:24.582535 run iperf3-srv_10.42.42.10(pid=7452): Terminating (SIGTERM) 01:13:24.622281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7455): Terminating (SIGTERM) 01:13:24.662261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7458): Terminating (SIGTERM) 01:13:24.702050 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7461): Terminating (SIGTERM) 01:13:24.742135 --- ParallelTerminationStrategy: PID 7449 died... 01:13:24.761140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7449): Terminated: ok {rc=0} 01:13:24.805555 --- ParallelTerminationStrategy: PID 7450 died... 01:13:24.824026 run iperf3-srv_10.42.42.10(pid=7450): Terminated {rc=256} 01:13:24.868347 --- ParallelTerminationStrategy: PID 7451 died... 01:13:24.886888 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7451): Terminated: ok {rc=0} 01:13:24.931263 --- ParallelTerminationStrategy: PID 7452 died... 01:13:24.949714 run iperf3-srv_10.42.42.10(pid=7452): Terminated {rc=256} 01:13:24.993707 --- ParallelTerminationStrategy: PID 7455 died... 01:13:25.012422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7455): Terminated: ok {rc=0} 01:13:25.056806 --- ParallelTerminationStrategy: PID 7458 died... 01:13:25.075918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7458): Terminated: ok {rc=0} 01:13:25.120482 --- ParallelTerminationStrategy: PID 7461 died... 01:13:25.139085 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7461): Terminated: ok {rc=0} 01:13:25.225356 bus /gobi_0: Setting Powered False 01:13:26.325845 bus /gobi_0: Setting Powered False 01:13:27.443047 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 01:13:28.591887 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:28.603806 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:13:28.677092 tst iperf3.py: using LAC 24957 01:13:28.796641 tst iperf3.py: using RAC 222 01:13:28.918318 tst iperf3.py: using CellId 24957 01:13:29.039469 tst iperf3.py: using BVCI 24958 01:13:29.159450 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:29.171199 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:29.182812 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:29.195406 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:29.207261 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:29.218863 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:29.232402 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:29.244573 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:29.255600 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:13:29.375124 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:13:29.597724 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:13:29.923989 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7464): Launched 01:13:30.207213 run iperf3-srv_10.42.42.10(pid=7465): Launched 01:13:30.330197 tst iperf3.py:8: start network... 01:13:30.550432 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:13:31.067948 run create_hlr_db(pid=7466): Launched 01:13:31.227231 bus /gobi_6: Setting Powered False 01:13:32.287496 run create_hlr_db(pid=7466): Terminated: ok {rc=0} 01:13:32.734537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7468): Launched 01:13:33.062632 run osmo-hlr_10.42.42.2(pid=7469): Launched 01:13:33.188249 run osmo-stp_10.42.42.5: Starting osmo-stp 01:13:33.754350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7471): Launched 01:13:34.082013 run osmo-stp_10.42.42.5(pid=7472): Launched 01:13:34.209122 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:13:34.772773 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7474): Launched 01:13:34.897480 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:13:35.172587 run patchelf(pid=7475): Launched 01:13:35.354276 run osmo-stp_10.42.42.5(pid=7472): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7472)] 01:13:35.491886 run osmo-stp_10.42.42.5(pid=7472): stdout: | (launched: 2022-12-10_01:13:34.022651) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:13:35.631188 run osmo-stp_10.42.42.5(pid=7472): stderr: | 20221210011334219 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011334219 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011334219 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011334220 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011334220 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011334220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011334220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:13:35.770353 run osmo-stp_10.42.42.5(pid=7472): stdout: | (launched: 2022-12-10_01:13:34.022651) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:13:35.904829 run osmo-stp_10.42.42.5(pid=7472): stderr: | 20221210011334219 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011334219 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011334219 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011334220 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011334220 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011334220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011334220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:13:36.063202 run patchelf(pid=7475): Terminating (SIGINT) 01:13:36.245184 run patchelf(pid=7475): Terminated: ok {rc=0} 01:13:36.376224 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7472): Process ended prematurely: osmo-stp_10.42.42.5(pid=7472) [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7472)] [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 01:13:36.386353 tst iperf3.py:8: Test FAILED (7.8 sec) 01:13:36.415024 run osmo-hlr_10.42.42.2(pid=7469): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7469)] 01:13:36.465423 run osmo-hlr_10.42.42.2(pid=7469): stdout: | (launched: 2022-12-10_01:13:33.003567) 01:13:36.517212 run osmo-hlr_10.42.42.2(pid=7469): stderr: | 20221210011333204 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011333204 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011333204 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011333205 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011333205 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011333205 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011333217 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011333226 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011333227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011333227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:13:36.569362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7464): Terminating (SIGTERM) 01:13:36.611025 run iperf3-srv_10.42.42.10(pid=7465): Terminating (SIGTERM) 01:13:36.652612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7468): Terminating (SIGTERM) 01:13:36.694720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7471): Terminating (SIGTERM) 01:13:36.736344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7474): Terminating (SIGTERM) 01:13:36.778309 --- ParallelTerminationStrategy: PID 7464 died... 01:13:36.798122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7464): Terminated: ok {rc=0} 01:13:36.843915 --- ParallelTerminationStrategy: PID 7465 died... 01:13:36.863283 run iperf3-srv_10.42.42.10(pid=7465): Terminated {rc=256} 01:13:36.909074 --- ParallelTerminationStrategy: PID 7468 died... 01:13:36.928364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7468): Terminated: ok {rc=0} 01:13:36.973834 --- ParallelTerminationStrategy: PID 7471 died... 01:13:36.993711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7471): Terminated: ok {rc=0} 01:13:37.039287 --- ParallelTerminationStrategy: PID 7474 died... 01:13:37.058776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7474): Terminated: ok {rc=0} 01:13:37.146945 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 01:13:38.297460 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:38.309744 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:13:38.381839 tst iperf3m4.py: using LAC 24958 01:13:38.509677 tst iperf3m4.py: using RAC 223 01:13:38.637391 tst iperf3m4.py: using CellId 24958 01:13:38.765130 tst iperf3m4.py: using BVCI 24959 01:13:38.882934 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:38.894498 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:38.905777 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:38.917126 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:38.928441 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:38.939786 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:38.951161 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:38.962332 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:38.973901 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:13:39.096328 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:13:39.218352 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:13:39.341018 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:13:39.458935 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:13:39.664788 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:13:39.973027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7476): Launched 01:13:40.240504 run iperf3-srv_10.42.42.10(pid=7477): Launched 01:13:40.356274 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:13:40.560511 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:13:40.866887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7478): Launched 01:13:41.133789 run iperf3-srv_10.42.42.10(pid=7479): Launched 01:13:41.250040 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:13:41.455684 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:13:41.764170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7480): Launched 01:13:42.031526 run iperf3-srv_10.42.42.10(pid=7481): Launched 01:13:42.146959 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:13:42.351018 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:13:42.657371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7482): Launched 01:13:42.925072 run iperf3-srv_10.42.42.10(pid=7483): Launched 01:13:43.040698 tst iperf3m4.py:8: start network... 01:13:43.245413 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:13:43.718727 run create_hlr_db(pid=7484): Launched 01:13:43.837601 bus /gobi_6: Setting Powered False 01:13:44.898161 run create_hlr_db(pid=7484): Terminated: ok {rc=0} 01:13:45.323530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7486): Launched 01:13:45.630579 run osmo-hlr_10.42.42.2(pid=7487): Launched 01:13:45.750325 run osmo-stp_10.42.42.5: Starting osmo-stp 01:13:46.434092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7489): Launched 01:13:46.760558 run osmo-stp_10.42.42.5(pid=7490): Launched 01:13:47.006640 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:13:47.692436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7492): Launched 01:13:47.817903 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:13:48.093617 run patchelf(pid=7493): Launched 01:13:48.277115 run osmo-stp_10.42.42.5(pid=7490): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7490)] 01:13:48.414817 run osmo-stp_10.42.42.5(pid=7490): stdout: | (launched: 2022-12-10_01:13:46.702694) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:13:48.555354 run osmo-stp_10.42.42.5(pid=7490): stderr: | 20221210011347033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011347033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011347033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011347034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011347034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011347034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011347034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:13:48.695170 run osmo-stp_10.42.42.5(pid=7490): stdout: | (launched: 2022-12-10_01:13:46.702694) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:13:48.829259 run osmo-stp_10.42.42.5(pid=7490): stderr: | 20221210011347033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011347033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011347033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011347034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011347034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011347034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011347034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:13:48.988160 run patchelf(pid=7493): Terminating (SIGINT) 01:13:49.170796 run patchelf(pid=7493): Terminated: ok {rc=0} 01:13:49.302192 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7490): Process ended prematurely: osmo-stp_10.42.42.5(pid=7490) [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7490)] [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 01:13:49.312397 tst iperf3m4.py:8: Test FAILED (11.1 sec) 01:13:49.341587 run osmo-hlr_10.42.42.2(pid=7487): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7487)] 01:13:49.391931 run osmo-hlr_10.42.42.2(pid=7487): stdout: | (launched: 2022-12-10_01:13:45.574043) 01:13:49.444187 run osmo-hlr_10.42.42.2(pid=7487): stderr: | 20221210011345751 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011345752 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011345752 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011345752 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011345752 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011345752 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011345764 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011345773 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011345773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011345773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:13:49.496770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7476): Terminating (SIGTERM) 01:13:49.539017 run iperf3-srv_10.42.42.10(pid=7477): Terminating (SIGTERM) 01:13:49.582549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7478): Terminating (SIGTERM) 01:13:49.625132 run iperf3-srv_10.42.42.10(pid=7479): Terminating (SIGTERM) 01:13:49.666943 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7480): Terminating (SIGTERM) 01:13:49.708734 run iperf3-srv_10.42.42.10(pid=7481): Terminating (SIGTERM) 01:13:49.751865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7482): Terminating (SIGTERM) 01:13:49.793933 run iperf3-srv_10.42.42.10(pid=7483): Terminating (SIGTERM) 01:13:49.835782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7486): Terminating (SIGTERM) 01:13:49.877807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7489): Terminating (SIGTERM) 01:13:49.919780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7492): Terminating (SIGTERM) 01:13:49.962446 --- ParallelTerminationStrategy: PID 7476 died... 01:13:49.982572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7476): Terminated: ok {rc=0} 01:13:50.028908 --- ParallelTerminationStrategy: PID 7477 died... 01:13:50.048919 run iperf3-srv_10.42.42.10(pid=7477): Terminated {rc=256} 01:13:50.094831 --- ParallelTerminationStrategy: PID 7478 died... 01:13:50.114506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7478): Terminated: ok {rc=0} 01:13:50.160570 --- ParallelTerminationStrategy: PID 7479 died... 01:13:50.180095 run iperf3-srv_10.42.42.10(pid=7479): Terminated {rc=256} 01:13:50.225959 --- ParallelTerminationStrategy: PID 7480 died... 01:13:50.245601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7480): Terminated: ok {rc=0} 01:13:50.291511 --- ParallelTerminationStrategy: PID 7481 died... 01:13:50.311099 run iperf3-srv_10.42.42.10(pid=7481): Terminated {rc=256} 01:13:50.357045 --- ParallelTerminationStrategy: PID 7482 died... 01:13:50.376798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7482): Terminated: ok {rc=0} 01:13:50.422783 --- ParallelTerminationStrategy: PID 7483 died... 01:13:50.442866 run iperf3-srv_10.42.42.10(pid=7483): Terminated {rc=256} 01:13:50.489024 --- ParallelTerminationStrategy: PID 7486 died... 01:13:50.508849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7486): Terminated: ok {rc=0} 01:13:50.555470 --- ParallelTerminationStrategy: PID 7489 died... 01:13:50.575320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7489): Terminated: ok {rc=0} 01:13:50.621830 --- ParallelTerminationStrategy: PID 7492 died... 01:13:50.641621 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7492): Terminated: ok {rc=0} 01:13:50.730480 bus /gobi_4: Setting Powered False 01:13:51.828717 bus /gobi_4: Setting Powered False 01:13:52.946312 bus /gobi_1: Setting Powered False 01:13:54.046725 bus /gobi_1: Setting Powered False 01:13:55.163248 bus /gobi_0: Setting Powered False 01:13:56.259131 bus /gobi_0: Setting Powered False 01:13:57.375875 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 01:13:58.479969 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:58.492026 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:13:58.563930 tst ping.py: using LAC 24959 01:13:58.681422 tst ping.py: using RAC 224 01:13:58.808125 tst ping.py: using CellId 24959 01:13:58.934016 tst ping.py: using BVCI 24960 01:13:59.050433 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:59.062286 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:59.073727 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:59.085283 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:59.096525 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:59.107909 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:59.119408 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:59.130716 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:13:59.249613 tst ping.py:19: start network... 01:13:59.465766 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:13:59.960533 run create_hlr_db(pid=7494): Launched 01:14:00.091103 bus /gobi_6: Setting Powered False 01:14:01.159365 run create_hlr_db(pid=7494): Terminated: ok {rc=0} 01:14:01.627568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7496): Launched 01:14:01.955430 run osmo-hlr_10.42.42.2(pid=7497): Launched 01:14:02.227876 run osmo-stp_10.42.42.5: Starting osmo-stp 01:14:02.832169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7499): Launched 01:14:03.152613 run osmo-stp_10.42.42.5(pid=7500): Launched 01:14:03.276448 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:14:03.827888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7502): Launched 01:14:03.952593 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:14:04.223726 run patchelf(pid=7503): Launched 01:14:04.403513 run osmo-stp_10.42.42.5(pid=7500): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7500)] 01:14:04.539267 run osmo-stp_10.42.42.5(pid=7500): stdout: | (launched: 2022-12-10_01:14:03.094179) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:14:04.676042 run osmo-stp_10.42.42.5(pid=7500): stderr: | 20221210011403288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011403288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011403288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011403289 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011403289 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011403290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011403290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:14:04.812714 run osmo-stp_10.42.42.5(pid=7500): stdout: | (launched: 2022-12-10_01:14:03.094179) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:14:04.944081 run osmo-stp_10.42.42.5(pid=7500): stderr: | 20221210011403288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011403288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011403288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011403289 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011403289 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011403290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011403290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:14:05.099647 run patchelf(pid=7503): Terminating (SIGINT) 01:14:05.278077 run patchelf(pid=7503): Terminated: ok {rc=0} 01:14:05.406426 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7500): Process ended prematurely: osmo-stp_10.42.42.5(pid=7500) [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7500)] [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 01:14:05.415837 tst ping.py:22: Test FAILED (6.9 sec) 01:14:05.444240 run osmo-hlr_10.42.42.2(pid=7497): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7497)] 01:14:05.494708 run osmo-hlr_10.42.42.2(pid=7497): stdout: | (launched: 2022-12-10_01:14:01.897998) 01:14:05.546361 run osmo-hlr_10.42.42.2(pid=7497): stderr: | 20221210011402127 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011402127 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011402127 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011402127 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011402127 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011402127 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011402142 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011402161 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011402162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011402162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:14:05.598014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7496): Terminating (SIGTERM) 01:14:05.639409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7499): Terminating (SIGTERM) 01:14:05.681346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7502): Terminating (SIGTERM) 01:14:05.723502 --- ParallelTerminationStrategy: PID 7496 died... 01:14:05.743599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7496): Terminated: ok {rc=0} 01:14:05.790019 --- ParallelTerminationStrategy: PID 7499 died... 01:14:05.809689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7499): Terminated: ok {rc=0} 01:14:05.855535 --- ParallelTerminationStrategy: PID 7502 died... 01:14:05.875316 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7502): Terminated: ok {rc=0} 01:14:05.963170 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 01:14:07.051977 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:07.064819 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:14:07.138579 tst ping_idle_ping.py: using LAC 24960 01:14:07.265975 tst ping_idle_ping.py: using RAC 225 01:14:07.391630 tst ping_idle_ping.py: using CellId 24960 01:14:07.517709 tst ping_idle_ping.py: using BVCI 24961 01:14:07.635344 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:07.646940 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:07.658343 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:07.669963 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:07.681406 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:07.692840 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:07.704524 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:07.715828 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:14:07.835149 tst ping_idle_ping.py:24: start network... 01:14:08.051851 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:14:08.559879 run create_hlr_db(pid=7504): Launched 01:14:08.692269 bus /gobi_6: Setting Powered False 01:14:09.756571 run create_hlr_db(pid=7504): Terminated: ok {rc=0} 01:14:10.206136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7506): Launched 01:14:10.531184 run osmo-hlr_10.42.42.2(pid=7507): Launched 01:14:10.655466 run osmo-stp_10.42.42.5: Starting osmo-stp 01:14:11.207423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7509): Launched 01:14:11.530801 run osmo-stp_10.42.42.5(pid=7510): Launched 01:14:11.655908 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:14:12.210132 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7512): Launched 01:14:12.334717 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:14:12.606314 run patchelf(pid=7513): Launched 01:14:12.786262 run osmo-stp_10.42.42.5(pid=7510): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7510)] 01:14:12.921541 run osmo-stp_10.42.42.5(pid=7510): stdout: | (launched: 2022-12-10_01:14:11.472003) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:14:13.058338 run osmo-stp_10.42.42.5(pid=7510): stderr: | 20221210011411664 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011411664 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011411664 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011411664 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011411667 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011411667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011411667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:14:13.195190 run osmo-stp_10.42.42.5(pid=7510): stdout: | (launched: 2022-12-10_01:14:11.472003) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:14:13.327141 run osmo-stp_10.42.42.5(pid=7510): stderr: | 20221210011411664 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011411664 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011411664 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011411664 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011411667 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011411667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011411667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:14:13.483348 run patchelf(pid=7513): Terminating (SIGINT) 01:14:13.662114 run patchelf(pid=7513): Terminated: ok {rc=0} 01:14:13.791312 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7510): Process ended prematurely: osmo-stp_10.42.42.5(pid=7510) [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7510)] [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 01:14:13.801036 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 01:14:13.829125 run osmo-hlr_10.42.42.2(pid=7507): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7507)] 01:14:13.878936 run osmo-hlr_10.42.42.2(pid=7507): stdout: | (launched: 2022-12-10_01:14:10.471634) 01:14:13.930398 run osmo-hlr_10.42.42.2(pid=7507): stderr: | 20221210011410671 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011410671 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011410671 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011410671 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011410671 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011410671 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011410683 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011410691 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011410692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011410692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:14:13.982360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7506): Terminating (SIGTERM) 01:14:14.023973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7509): Terminating (SIGTERM) 01:14:14.065698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7512): Terminating (SIGTERM) 01:14:14.107454 --- ParallelTerminationStrategy: PID 7506 died... 01:14:14.127078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7506): Terminated: ok {rc=0} 01:14:14.173160 --- ParallelTerminationStrategy: PID 7509 died... 01:14:14.192621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7509): Terminated: ok {rc=0} 01:14:14.238226 --- ParallelTerminationStrategy: PID 7512 died... 01:14:14.257698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7512): Terminated: ok {rc=0} 01:14:14.345019 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 01:14:15.653377 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:14:15.659886 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 01:14:15.694844 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 01:14:15.733054 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 01:14:15.819391 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 01:14:15.860787 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 01:14:15.918375 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 01:14:16.495790 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 01:14:16.565807 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:16.580336 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:14:16.652793 tst cs_paging_gprs_active.py: using LAC 24961 01:14:16.786974 tst cs_paging_gprs_active.py: using RAC 226 01:14:16.959579 tst cs_paging_gprs_active.py: using CellId 24961 01:14:17.081337 tst cs_paging_gprs_active.py: using BVCI 24962 01:14:17.212040 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:17.224319 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:17.236222 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:17.248093 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:17.261689 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:17.273652 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:17.286760 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:17.298969 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:17.311108 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:14:17.434078 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:14:17.552773 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:14:17.759393 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:14:18.067257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7517): Launched 01:14:18.334632 run iperf3-srv_10.42.42.10(pid=7518): Launched 01:14:18.452195 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:14:18.657347 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:14:18.965131 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7519): Launched 01:14:19.232603 run iperf3-srv_10.42.42.10(pid=7520): Launched 01:14:19.348163 tst cs_paging_gprs_active.py:38: start network... 01:14:19.553208 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:14:20.028040 run create_hlr_db(pid=7521): Launched 01:14:20.145968 bus /gobi_6: Setting Powered False 01:14:21.206556 run create_hlr_db(pid=7521): Terminated: ok {rc=0} 01:14:21.652760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7523): Launched 01:14:21.981220 run osmo-hlr_10.42.42.2(pid=7524): Launched 01:14:22.107233 run osmo-stp_10.42.42.5: Starting osmo-stp 01:14:22.668851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7526): Launched 01:14:22.994192 run osmo-stp_10.42.42.5(pid=7527): Launched 01:14:23.121344 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:14:23.685306 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7529): Launched 01:14:23.811810 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:14:24.087339 run patchelf(pid=7530): Launched 01:14:24.271149 run osmo-stp_10.42.42.5(pid=7527): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7527)] 01:14:24.409054 run osmo-stp_10.42.42.5(pid=7527): stdout: | (launched: 2022-12-10_01:14:22.935187) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:14:24.548281 run osmo-stp_10.42.42.5(pid=7527): stderr: | 20221210011423127 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011423127 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011423127 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011423127 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011423128 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011423128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011423128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:14:24.687305 run osmo-stp_10.42.42.5(pid=7527): stdout: | (launched: 2022-12-10_01:14:22.935187) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:14:24.820633 run osmo-stp_10.42.42.5(pid=7527): stderr: | 20221210011423127 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011423127 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011423127 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011423127 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011423128 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011423128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011423128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:14:24.978560 run patchelf(pid=7530): Terminating (SIGINT) 01:14:25.160559 run patchelf(pid=7530): Terminated: ok {rc=0} 01:14:25.291582 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7527): Process ended prematurely: osmo-stp_10.42.42.5(pid=7527) [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7527)] [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 01:14:25.302051 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 01:14:25.330884 run osmo-hlr_10.42.42.2(pid=7524): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7524)] 01:14:25.381162 run osmo-hlr_10.42.42.2(pid=7524): stdout: | (launched: 2022-12-10_01:14:21.920838) 01:14:25.433127 run osmo-hlr_10.42.42.2(pid=7524): stderr: | 20221210011422123 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011422124 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011422124 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011422124 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011422124 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011422124 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011422137 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011422145 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011422145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011422145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:14:25.485887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7517): Terminating (SIGTERM) 01:14:25.527999 run iperf3-srv_10.42.42.10(pid=7518): Terminating (SIGTERM) 01:14:25.570185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7519): Terminating (SIGTERM) 01:14:25.612055 run iperf3-srv_10.42.42.10(pid=7520): Terminating (SIGTERM) 01:14:25.653931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7523): Terminating (SIGTERM) 01:14:25.695777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7526): Terminating (SIGTERM) 01:14:25.737636 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7529): Terminating (SIGTERM) 01:14:25.779585 --- ParallelTerminationStrategy: PID 7517 died... 01:14:25.799686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7517): Terminated: ok {rc=0} 01:14:25.846636 --- ParallelTerminationStrategy: PID 7518 died... 01:14:25.866136 run iperf3-srv_10.42.42.10(pid=7518): Terminated {rc=256} 01:14:25.912037 --- ParallelTerminationStrategy: PID 7519 died... 01:14:25.931373 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7519): Terminated: ok {rc=0} 01:14:25.977356 --- ParallelTerminationStrategy: PID 7520 died... 01:14:25.997263 run iperf3-srv_10.42.42.10(pid=7520): Terminated {rc=256} 01:14:26.043139 --- ParallelTerminationStrategy: PID 7523 died... 01:14:26.062653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7523): Terminated: ok {rc=0} 01:14:26.108893 --- ParallelTerminationStrategy: PID 7526 died... 01:14:26.128869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7526): Terminated: ok {rc=0} 01:14:26.175120 --- ParallelTerminationStrategy: PID 7529 died... 01:14:26.194724 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7529): Terminated: ok {rc=0} 01:14:26.283162 bus /gobi_0: Setting Powered False 01:14:27.383901 bus /gobi_0: Setting Powered False 01:14:28.500732 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 01:14:29.652407 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:29.664932 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:14:29.741162 tst iperf3.py: using LAC 24962 01:14:29.871363 tst iperf3.py: using RAC 227 01:14:30.000440 tst iperf3.py: using CellId 24962 01:14:30.121503 tst iperf3.py: using BVCI 24963 01:14:30.233662 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:30.244785 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:30.256118 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:30.267591 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:30.279025 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:30.290459 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:30.301962 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:30.313223 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:30.325058 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:14:30.443732 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:14:30.664830 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:14:31.013762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7531): Launched 01:14:31.311866 run iperf3-srv_10.42.42.10(pid=7532): Launched 01:14:31.450608 tst iperf3.py:8: start network... 01:14:31.693954 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:14:32.199194 run create_hlr_db(pid=7533): Launched 01:14:32.344704 bus /gobi_6: Setting Powered False 01:14:33.409818 run create_hlr_db(pid=7533): Terminated: ok {rc=0} 01:14:33.846545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7535): Launched 01:14:34.152768 run osmo-hlr_10.42.42.2(pid=7536): Launched 01:14:34.270490 run osmo-stp_10.42.42.5: Starting osmo-stp 01:14:34.797546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7538): Launched 01:14:35.104743 run osmo-stp_10.42.42.5(pid=7539): Launched 01:14:35.222310 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:14:35.748819 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7541): Launched 01:14:35.866436 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:14:36.125387 run patchelf(pid=7542): Launched 01:14:36.296855 run osmo-stp_10.42.42.5(pid=7539): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7539)] 01:14:36.426899 run osmo-stp_10.42.42.5(pid=7539): stdout: | (launched: 2022-12-10_01:14:35.048150) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:14:36.558592 run osmo-stp_10.42.42.5(pid=7539): stderr: | 20221210011435221 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011435221 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011435222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011435222 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011435223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011435223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011435223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:14:36.690021 run osmo-stp_10.42.42.5(pid=7539): stdout: | (launched: 2022-12-10_01:14:35.048150) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:14:36.816185 run osmo-stp_10.42.42.5(pid=7539): stderr: | 20221210011435221 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011435221 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011435222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011435222 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011435223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011435223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011435223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:14:36.965730 run patchelf(pid=7542): Terminating (SIGINT) 01:14:37.137548 run patchelf(pid=7542): Terminated: ok {rc=0} 01:14:37.261916 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7539): Process ended prematurely: osmo-stp_10.42.42.5(pid=7539) [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7539)] [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 01:14:37.271687 tst iperf3.py:8: Test FAILED (7.7 sec) 01:14:37.299737 run osmo-hlr_10.42.42.2(pid=7536): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7536)] 01:14:37.348046 run osmo-hlr_10.42.42.2(pid=7536): stdout: | (launched: 2022-12-10_01:14:34.096697) 01:14:37.397797 run osmo-hlr_10.42.42.2(pid=7536): stderr: | 20221210011434275 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011434275 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011434275 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011434275 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011434275 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011434276 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011434288 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011434297 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011434297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011434297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:14:37.448055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7531): Terminating (SIGTERM) 01:14:37.488190 run iperf3-srv_10.42.42.10(pid=7532): Terminating (SIGTERM) 01:14:37.529001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7535): Terminating (SIGTERM) 01:14:37.569280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7538): Terminating (SIGTERM) 01:14:37.609523 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7541): Terminating (SIGTERM) 01:14:37.649711 --- ParallelTerminationStrategy: PID 7531 died... 01:14:37.668891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7531): Terminated: ok {rc=0} 01:14:37.713170 --- ParallelTerminationStrategy: PID 7532 died... 01:14:37.731544 run iperf3-srv_10.42.42.10(pid=7532): Terminated {rc=256} 01:14:37.775905 --- ParallelTerminationStrategy: PID 7535 died... 01:14:37.794697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7535): Terminated: ok {rc=0} 01:14:37.839654 --- ParallelTerminationStrategy: PID 7538 died... 01:14:37.858506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7538): Terminated: ok {rc=0} 01:14:37.902567 --- ParallelTerminationStrategy: PID 7541 died... 01:14:37.921304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7541): Terminated: ok {rc=0} 01:14:38.007579 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 01:14:39.156795 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:39.168779 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:14:39.241438 tst iperf3m4.py: using LAC 24963 01:14:39.363178 tst iperf3m4.py: using RAC 228 01:14:39.484051 tst iperf3m4.py: using CellId 24963 01:14:39.604363 tst iperf3m4.py: using BVCI 24964 01:14:39.716493 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:39.727751 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:39.738891 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:39.750152 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:39.761544 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:39.772559 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:39.783975 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:39.795042 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:39.806483 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:14:39.927111 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:14:40.047849 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:14:40.167342 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:14:40.284560 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:14:40.490784 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:14:40.797140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7543): Launched 01:14:41.064547 run iperf3-srv_10.42.42.10(pid=7544): Launched 01:14:41.179769 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:14:41.384145 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:14:41.690401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7545): Launched 01:14:41.959103 run iperf3-srv_10.42.42.10(pid=7546): Launched 01:14:42.074446 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:14:42.278243 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:14:42.585420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7547): Launched 01:14:42.851780 run iperf3-srv_10.42.42.10(pid=7548): Launched 01:14:42.967068 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:14:43.171064 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:14:43.477270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7549): Launched 01:14:43.742785 run iperf3-srv_10.42.42.10(pid=7550): Launched 01:14:43.857825 tst iperf3m4.py:8: start network... 01:14:44.061190 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:14:44.533476 run create_hlr_db(pid=7551): Launched 01:14:44.650917 bus /gobi_6: Setting Powered False 01:14:45.711411 run create_hlr_db(pid=7551): Terminated: ok {rc=0} 01:14:46.145739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7553): Launched 01:14:46.493252 run osmo-hlr_10.42.42.2(pid=7554): Launched 01:14:46.620425 run osmo-stp_10.42.42.5: Starting osmo-stp 01:14:47.448514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7556): Launched 01:14:47.754645 run osmo-stp_10.42.42.5(pid=7557): Launched 01:14:47.872257 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:14:48.414845 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7559): Launched 01:14:48.532881 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:14:48.791957 run patchelf(pid=7560): Launched 01:14:48.962417 run osmo-stp_10.42.42.5(pid=7557): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7557)] 01:14:49.091803 run osmo-stp_10.42.42.5(pid=7557): stdout: | (launched: 2022-12-10_01:14:47.698532) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:14:49.222947 run osmo-stp_10.42.42.5(pid=7557): stderr: | 20221210011447869 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011447870 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011447870 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011447870 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011447871 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011447871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011447871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:14:49.353502 run osmo-stp_10.42.42.5(pid=7557): stdout: | (launched: 2022-12-10_01:14:47.698532) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:14:49.479044 run osmo-stp_10.42.42.5(pid=7557): stderr: | 20221210011447869 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011447870 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011447870 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011447870 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011447871 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011447871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011447871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:14:49.628029 run patchelf(pid=7560): Terminating (SIGINT) 01:14:49.798898 run patchelf(pid=7560): Terminated: ok {rc=0} 01:14:49.921442 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7557): Process ended prematurely: osmo-stp_10.42.42.5(pid=7557) [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7557)] [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 01:14:49.930996 tst iperf3m4.py:8: Test FAILED (10.8 sec) 01:14:49.959181 run osmo-hlr_10.42.42.2(pid=7554): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7554)] 01:14:50.007352 run osmo-hlr_10.42.42.2(pid=7554): stdout: | (launched: 2022-12-10_01:14:46.434641) 01:14:50.057287 run osmo-hlr_10.42.42.2(pid=7554): stderr: | 20221210011446740 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011446740 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011446740 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011446740 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011446740 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011446740 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011446752 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011446768 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011446768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011446769 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:14:50.107601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7543): Terminating (SIGTERM) 01:14:50.147958 run iperf3-srv_10.42.42.10(pid=7544): Terminating (SIGTERM) 01:14:50.188115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7545): Terminating (SIGTERM) 01:14:50.228335 run iperf3-srv_10.42.42.10(pid=7546): Terminating (SIGTERM) 01:14:50.268518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7547): Terminating (SIGTERM) 01:14:50.308653 run iperf3-srv_10.42.42.10(pid=7548): Terminating (SIGTERM) 01:14:50.348515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7549): Terminating (SIGTERM) 01:14:50.388515 run iperf3-srv_10.42.42.10(pid=7550): Terminating (SIGTERM) 01:14:50.428569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7553): Terminating (SIGTERM) 01:14:50.469122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7556): Terminating (SIGTERM) 01:14:50.509584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7559): Terminating (SIGTERM) 01:14:50.550256 --- ParallelTerminationStrategy: PID 7543 died... 01:14:50.569548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7543): Terminated: ok {rc=0} 01:14:50.614365 --- ParallelTerminationStrategy: PID 7544 died... 01:14:50.632853 run iperf3-srv_10.42.42.10(pid=7544): Terminated {rc=256} 01:14:50.677612 --- ParallelTerminationStrategy: PID 7545 died... 01:14:50.696586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7545): Terminated: ok {rc=0} 01:14:50.740927 --- ParallelTerminationStrategy: PID 7546 died... 01:14:50.759505 run iperf3-srv_10.42.42.10(pid=7546): Terminated {rc=256} 01:14:50.804124 --- ParallelTerminationStrategy: PID 7547 died... 01:14:50.822772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7547): Terminated: ok {rc=0} 01:14:50.867407 --- ParallelTerminationStrategy: PID 7548 died... 01:14:50.886095 run iperf3-srv_10.42.42.10(pid=7548): Terminated {rc=256} 01:14:50.930496 --- ParallelTerminationStrategy: PID 7549 died... 01:14:50.949429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7549): Terminated: ok {rc=0} 01:14:50.993991 --- ParallelTerminationStrategy: PID 7550 died... 01:14:51.012692 run iperf3-srv_10.42.42.10(pid=7550): Terminated {rc=256} 01:14:51.057201 --- ParallelTerminationStrategy: PID 7553 died... 01:14:51.075996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7553): Terminated: ok {rc=0} 01:14:51.120706 --- ParallelTerminationStrategy: PID 7556 died... 01:14:51.139380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7556): Terminated: ok {rc=0} 01:14:51.183905 --- ParallelTerminationStrategy: PID 7559 died... 01:14:51.203148 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7559): Terminated: ok {rc=0} 01:14:51.288105 bus /gobi_4: Setting Powered False 01:14:52.384990 bus /gobi_4: Setting Powered False 01:14:53.501257 bus /gobi_1: Setting Powered False 01:14:54.601947 bus /gobi_1: Setting Powered False 01:14:55.716291 bus /gobi_0: Setting Powered False 01:14:56.815254 bus /gobi_0: Setting Powered False 01:14:57.932636 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 01:14:59.036800 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:59.049586 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:14:59.123122 tst ping.py: using LAC 24964 01:14:59.252713 tst ping.py: using RAC 229 01:14:59.370610 tst ping.py: using CellId 24964 01:14:59.485840 tst ping.py: using BVCI 24965 01:14:59.594653 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:59.605860 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:59.616828 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:59.628133 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:59.639603 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:59.651022 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:59.662374 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:59.674012 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:14:59.788712 tst ping.py:19: start network... 01:14:59.987880 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:15:00.449878 run create_hlr_db(pid=7561): Launched 01:15:00.565238 bus /gobi_6: Setting Powered False 01:15:01.642475 run create_hlr_db(pid=7561): Terminated: ok {rc=0} 01:15:02.100020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7566): Launched 01:15:02.415584 run osmo-hlr_10.42.42.2(pid=7567): Launched 01:15:02.531903 run osmo-stp_10.42.42.5: Starting osmo-stp 01:15:03.056327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7569): Launched 01:15:03.357531 run osmo-stp_10.42.42.5(pid=7570): Launched 01:15:03.474245 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:15:03.992393 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7572): Launched 01:15:04.107775 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:15:04.359335 run patchelf(pid=7573): Launched 01:15:04.526330 run osmo-stp_10.42.42.5(pid=7570): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7570)] 01:15:04.652881 run osmo-stp_10.42.42.5(pid=7570): stdout: | (launched: 2022-12-10_01:15:03.302005) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:15:04.780633 run osmo-stp_10.42.42.5(pid=7570): stderr: | 20221210011503471 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011503471 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011503471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011503472 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011503474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011503474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011503474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:15:04.908424 run osmo-stp_10.42.42.5(pid=7570): stdout: | (launched: 2022-12-10_01:15:03.302005) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:15:05.031401 run osmo-stp_10.42.42.5(pid=7570): stderr: | 20221210011503471 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011503471 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011503471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011503472 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011503474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011503474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011503474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:15:05.176756 run patchelf(pid=7573): Terminating (SIGINT) 01:15:05.343560 run patchelf(pid=7573): Terminated: ok {rc=0} 01:15:05.463999 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7570): Process ended prematurely: osmo-stp_10.42.42.5(pid=7570) [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7570)] [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 01:15:05.473022 tst ping.py:22: Test FAILED (6.4 sec) 01:15:05.500369 run osmo-hlr_10.42.42.2(pid=7567): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7567)] 01:15:05.547752 run osmo-hlr_10.42.42.2(pid=7567): stdout: | (launched: 2022-12-10_01:15:02.360200) 01:15:05.596853 run osmo-hlr_10.42.42.2(pid=7567): stderr: | 20221210011502534 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011502534 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011502535 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011502535 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011502535 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011502535 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011502547 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011502557 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011502558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011502558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:15:05.646296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7566): Terminating (SIGTERM) 01:15:05.686084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7569): Terminating (SIGTERM) 01:15:05.725776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7572): Terminating (SIGTERM) 01:15:05.765827 --- ParallelTerminationStrategy: PID 7566 died... 01:15:05.784691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7566): Terminated: ok {rc=0} 01:15:05.829202 --- ParallelTerminationStrategy: PID 7569 died... 01:15:05.847732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7569): Terminated: ok {rc=0} 01:15:05.891725 --- ParallelTerminationStrategy: PID 7572 died... 01:15:05.910318 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7572): Terminated: ok {rc=0} 01:15:05.995796 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 01:15:07.085025 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:07.097533 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:15:07.173245 tst ping_idle_ping.py: using LAC 24965 01:15:07.298884 tst ping_idle_ping.py: using RAC 230 01:15:07.415952 tst ping_idle_ping.py: using CellId 24965 01:15:07.532053 tst ping_idle_ping.py: using BVCI 24966 01:15:07.640735 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:07.651993 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:07.662923 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:07.674117 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:07.685150 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:07.696165 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:07.707437 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:07.718361 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:15:07.834791 tst ping_idle_ping.py:24: start network... 01:15:08.035042 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:15:08.503130 run create_hlr_db(pid=7574): Launched 01:15:08.620355 bus /gobi_6: Setting Powered False 01:15:09.681187 run create_hlr_db(pid=7574): Terminated: ok {rc=0} 01:15:10.120409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7576): Launched 01:15:10.442427 run osmo-hlr_10.42.42.2(pid=7577): Launched 01:15:10.568868 run osmo-stp_10.42.42.5: Starting osmo-stp 01:15:11.123000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7579): Launched 01:15:11.445929 run osmo-stp_10.42.42.5(pid=7580): Launched 01:15:11.571016 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:15:12.127181 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7582): Launched 01:15:12.250831 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:15:12.522703 run patchelf(pid=7583): Launched 01:15:12.704508 run osmo-stp_10.42.42.5(pid=7580): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7580)] 01:15:12.840649 run osmo-stp_10.42.42.5(pid=7580): stdout: | (launched: 2022-12-10_01:15:11.387124) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:15:12.978484 run osmo-stp_10.42.42.5(pid=7580): stderr: | 20221210011511578 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011511578 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011511578 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011511579 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011511581 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011511581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011511581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:15:13.117912 run osmo-stp_10.42.42.5(pid=7580): stdout: | (launched: 2022-12-10_01:15:11.387124) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:15:13.251094 run osmo-stp_10.42.42.5(pid=7580): stderr: | 20221210011511578 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011511578 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011511578 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011511579 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011511581 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011511581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011511581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:15:13.408172 run patchelf(pid=7583): Terminating (SIGINT) 01:15:13.590030 run patchelf(pid=7583): Terminated: ok {rc=0} 01:15:13.720453 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7580): Process ended prematurely: osmo-stp_10.42.42.5(pid=7580) [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7580)] [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 01:15:13.730151 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 01:15:13.758545 run osmo-hlr_10.42.42.2(pid=7577): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7577)] 01:15:13.808292 run osmo-hlr_10.42.42.2(pid=7577): stdout: | (launched: 2022-12-10_01:15:10.383978) 01:15:13.859947 run osmo-hlr_10.42.42.2(pid=7577): stderr: | 20221210011510583 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011510583 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011510583 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011510583 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011510583 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011510583 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011510596 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011510605 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011510605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011510605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:15:13.911977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7576): Terminating (SIGTERM) 01:15:13.953825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7579): Terminating (SIGTERM) 01:15:13.995666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7582): Terminating (SIGTERM) 01:15:14.038149 --- ParallelTerminationStrategy: PID 7576 died... 01:15:14.058255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7576): Terminated: ok {rc=0} 01:15:14.104588 --- ParallelTerminationStrategy: PID 7579 died... 01:15:14.124160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7579): Terminated: ok {rc=0} 01:15:14.170340 --- ParallelTerminationStrategy: PID 7582 died... 01:15:14.190139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7582): Terminated: ok {rc=0} 01:15:14.278273 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:15:15.592458 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:15:15.599770 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:15:15.634494 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 01:15:15.669698 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:15:15.723767 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:15:15.758032 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 01:15:15.792857 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:15:16.393501 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2367 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 01:15:16.402240 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:15:16.417833 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:15:16.500932 tst switch_tch_pdch.py: using LAC 24966 01:15:16.625264 tst switch_tch_pdch.py: using RAC 231 01:15:16.791441 tst switch_tch_pdch.py: using CellId 24966 01:15:16.918814 tst switch_tch_pdch.py: using BVCI 24967 01:15:17.039430 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:15:17.052369 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:15:17.066057 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:15:17.079258 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:15:17.091840 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:15:17.104657 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:15:17.117979 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:15:17.131429 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:15:17.257107 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:15:17.374346 tst switch_tch_pdch.py:51: start network... 01:15:17.576414 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:15:18.042688 run create_hlr_db(pid=7590): Launched 01:15:18.160686 bus /gobi_6: Setting Powered False 01:15:19.220838 run create_hlr_db(pid=7590): Terminated: ok {rc=0} 01:15:19.640215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7592): Launched 01:15:19.942078 run osmo-hlr_10.42.42.2(pid=7593): Launched 01:15:20.057299 run osmo-stp_10.42.42.5: Starting osmo-stp 01:15:20.572000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7595): Launched 01:15:20.873264 run osmo-stp_10.42.42.5(pid=7596): Launched 01:15:20.988560 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:15:21.505871 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7598): Launched 01:15:21.624034 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:15:21.878095 run patchelf(pid=7599): Launched 01:15:22.045321 run osmo-stp_10.42.42.5(pid=7596): ERR: Terminated: ERROR {rc=1} [trial-2367↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7596)] 01:15:22.172022 run osmo-stp_10.42.42.5(pid=7596): stdout: | (launched: 2022-12-10_01:15:20.818119) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:15:22.300417 run osmo-stp_10.42.42.5(pid=7596): stderr: | 20221210011520988 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011520988 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011520989 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011520989 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011520989 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011520990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011520990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:15:22.428934 run osmo-stp_10.42.42.5(pid=7596): stdout: | (launched: 2022-12-10_01:15:20.818119) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:15:22.552117 run osmo-stp_10.42.42.5(pid=7596): stderr: | 20221210011520988 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011520988 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011520989 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011520989 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011520989 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011520990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011520990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:15:22.698783 run patchelf(pid=7599): Terminating (SIGINT) 01:15:22.866110 run patchelf(pid=7599): Terminated: ok {rc=0} 01:15:22.986827 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=7596): Process ended prematurely: osmo-stp_10.42.42.5(pid=7596) [trial-2367↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7596)] [trial-2367↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 01:15:22.995659 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 01:15:23.022812 run osmo-hlr_10.42.42.2(pid=7593): ERR: Terminated: ERROR {rc=237} [trial-2367↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7593)] 01:15:23.070980 run osmo-hlr_10.42.42.2(pid=7593): stdout: | (launched: 2022-12-10_01:15:19.886640) 01:15:23.120774 run osmo-hlr_10.42.42.2(pid=7593): stderr: | 20221210011520063 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011520063 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011520063 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011520063 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011520064 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011520064 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011520076 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011520085 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011520085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011520085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:15:23.171067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7592): Terminating (SIGTERM) 01:15:23.211130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7595): Terminating (SIGTERM) 01:15:23.251835 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7598): Terminating (SIGTERM) 01:15:23.292086 --- ParallelTerminationStrategy: PID 7592 died... 01:15:23.311697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7592): Terminated: ok {rc=0} 01:15:23.356424 --- ParallelTerminationStrategy: PID 7595 died... 01:15:23.375173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7595): Terminated: ok {rc=0} 01:15:23.419645 --- ParallelTerminationStrategy: PID 7598 died... 01:15:23.438272 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7598): Terminated: ok {rc=0} 01:15:23.524509 bus /gobi_0: Setting Powered False 01:15:24.625114 bus /gobi_0: Setting Powered False 01:15:25.743428 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 01:15:26.996682 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:15:27.002638 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 01:15:27.036813 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 01:15:27.071490 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 01:15:27.124551 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 01:15:27.158086 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 01:15:27.192172 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 01:15:27.748640 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2367 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 01:15:27.753944 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:15:27.764915 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 01:15:27.835073 tst switch_tch_pdch.py: using LAC 24967 01:15:27.953805 tst switch_tch_pdch.py: using RAC 232 01:15:28.070590 tst switch_tch_pdch.py: using CellId 24967 01:15:28.186759 tst switch_tch_pdch.py: using BVCI 24968 01:15:28.296271 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:15:28.307312 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:15:28.318155 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:15:28.329318 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:15:28.340186 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:15:28.351449 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:15:28.362805 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:15:28.374016 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 01:15:28.494477 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 01:15:28.614077 tst switch_tch_pdch.py:51: start network... 01:15:28.830243 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:15:29.298081 run create_hlr_db(pid=7603): Launched 01:15:29.431389 bus /gobi_6: Setting Powered False 01:15:30.494736 run create_hlr_db(pid=7603): Terminated: ok {rc=0} 01:15:30.933980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7605): Launched 01:15:31.251251 run osmo-hlr_10.42.42.2(pid=7606): Launched 01:15:31.447251 run osmo-stp_10.42.42.5: Starting osmo-stp 01:15:32.058902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7608): Launched 01:15:32.378341 run osmo-stp_10.42.42.5(pid=7609): Launched 01:15:32.496506 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:15:32.990182 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7611): Launched 01:15:33.105611 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:15:33.358394 run patchelf(pid=7612): Launched 01:15:33.526044 run osmo-stp_10.42.42.5(pid=7609): ERR: Terminated: ERROR {rc=1} [trial-2367↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7609)] 01:15:33.652802 run osmo-stp_10.42.42.5(pid=7609): stdout: | (launched: 2022-12-10_01:15:32.322872) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:15:33.781295 run osmo-stp_10.42.42.5(pid=7609): stderr: | 20221210011532493 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011532493 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011532494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011532494 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011532494 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011532494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011532495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:15:33.909285 run osmo-stp_10.42.42.5(pid=7609): stdout: | (launched: 2022-12-10_01:15:32.322872) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:15:34.032481 run osmo-stp_10.42.42.5(pid=7609): stderr: | 20221210011532493 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011532493 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011532494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011532494 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011532494 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011532494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011532495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:15:34.178631 run patchelf(pid=7612): Terminating (SIGINT) 01:15:34.345593 run patchelf(pid=7612): Terminated: ok {rc=0} 01:15:34.465813 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=7609): Process ended prematurely: osmo-stp_10.42.42.5(pid=7609) [trial-2367↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7609)] [trial-2367↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 01:15:34.474819 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 01:15:34.502182 run osmo-hlr_10.42.42.2(pid=7606): ERR: Terminated: ERROR {rc=237} [trial-2367↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7606)] 01:15:34.549858 run osmo-hlr_10.42.42.2(pid=7606): stdout: | (launched: 2022-12-10_01:15:31.190853) 01:15:34.599207 run osmo-hlr_10.42.42.2(pid=7606): stderr: | 20221210011531575 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011531575 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011531575 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011531575 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011531575 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011531575 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011531605 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011531619 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011531619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011531619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:15:34.649414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7605): Terminating (SIGTERM) 01:15:34.689414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7608): Terminating (SIGTERM) 01:15:34.729262 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7611): Terminating (SIGTERM) 01:15:34.770177 --- ParallelTerminationStrategy: PID 7605 died... 01:15:34.789258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7605): Terminated: ok {rc=0} 01:15:34.833841 --- ParallelTerminationStrategy: PID 7608 died... 01:15:34.852422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7608): Terminated: ok {rc=0} 01:15:34.896639 --- ParallelTerminationStrategy: PID 7611 died... 01:15:34.915245 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7611): Terminated: ok {rc=0} 01:15:35.000920 bus /gobi_0: Setting Powered False 01:15:36.101071 bus /gobi_0: Setting Powered False 01:15:37.214530 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 nitb_sms:trx-umtrx --------------------------------------------------------------------- 01:15:38.476444 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:15:38.480518 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 01:15:38.513910 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 01:15:38.521012 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 01:15:38.575361 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 01:15:38.608763 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 01:15:38.615741 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 01:15:39.155911 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 01:15:39.161982 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 01:15:39.173843 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 01:15:39.222255 tst mo_mt_sms.py: using LAC 24968 01:15:39.346579 tst mo_mt_sms.py: using RAC 233 01:15:39.470622 tst mo_mt_sms.py: using CellId 24968 01:15:39.596237 tst mo_mt_sms.py: using BVCI 24969 01:15:39.714213 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 01:15:39.829009 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 01:15:39.941478 tst mo_mt_sms.py:9: start nitb and bts... 01:15:40.143612 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:15:40.757592 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7617): Launched 01:15:41.061741 run osmo-nitb_10.42.42.2(pid=7618): Launched 01:15:41.230416 run osmo-nitb_10.42.42.2(pid=7618): ERR: Terminated: ERROR {rc=2} [trial-2367↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7618)] 01:15:41.365822 run osmo-nitb_10.42.42.2(pid=7618): stdout: | (launched: 2022-12-10_01:15:41.006056) 01:15:41.502574 run osmo-nitb_10.42.42.2(pid=7618): stderr: | (launched: 2022-12-10_01:15:41.051159) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:15:41.639311 run osmo-nitb_10.42.42.2(pid=7618): stdout: | (launched: 2022-12-10_01:15:41.006056) 01:15:41.771137 run osmo-nitb_10.42.42.2(pid=7618): stderr: | (launched: 2022-12-10_01:15:41.051159) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=7618): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7618) [trial-2367↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7618)] 01:15:42.176297 tst osmo-nitb_10.42.42.2(pid=7618): stdout: | (launched: 2022-12-10_01:15:41.006056) 01:15:42.305859 tst osmo-nitb_10.42.42.2(pid=7618): stderr: | (launched: 2022-12-10_01:15:41.051159) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:15:42.458946 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=7618): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7618) [trial-2367↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7618)] [trial-2367↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 01:15:42.467982 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 01:15:42.475053 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7617): Terminating (SIGTERM) 01:15:42.686063 --- ParallelTerminationStrategy: PID 7617 died... 01:15:42.708661 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7617): Terminated: ok {rc=0} 01:15:42.796818 bus /sierra_3: Setting Powered False 01:15:43.895770 bus /sierra_3: Setting Powered False 01:15:45.012308 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 sms:trx-umtrx --------------------------------------------------------------------- 01:15:46.215277 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:15:46.219988 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 01:15:46.254454 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 01:15:46.282256 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 01:15:46.334868 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 01:15:46.378975 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 01:15:46.414748 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 01:15:46.972479 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 01:15:46.978000 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:15:46.990127 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 01:15:47.039387 tst mo_mt_sms.py: using LAC 24969 01:15:47.197122 tst mo_mt_sms.py: using RAC 234 01:15:47.323377 tst mo_mt_sms.py: using CellId 24969 01:15:47.448668 tst mo_mt_sms.py: using BVCI 24970 01:15:47.565984 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:15:47.576908 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:15:47.587911 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:15:47.598784 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:15:47.609746 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:15:47.620617 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 01:15:47.736642 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 01:15:47.855758 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:15:48.350809 run create_hlr_db(pid=7622): Launched 01:15:48.483451 bus /sierra_2: Setting Powered False 01:15:49.547074 run create_hlr_db(pid=7622): Terminated: ok {rc=0} 01:15:49.973736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7624): Launched 01:15:50.274009 run osmo-hlr_10.42.42.2(pid=7625): Launched 01:15:50.389841 run osmo-stp_10.42.42.5: Starting osmo-stp 01:15:50.920410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7627): Launched 01:15:51.221706 run osmo-stp_10.42.42.5(pid=7628): Launched 01:15:51.337748 run osmo-msc_10.42.42.6: Starting osmo-msc 01:15:51.885819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7630): Launched 01:15:52.207747 run osmo-msc_10.42.42.6(pid=7631): Launched 01:15:52.389125 run osmo-stp_10.42.42.5(pid=7628): ERR: Terminated: ERROR {rc=1} [trial-2367↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7628)] 01:15:52.525157 run osmo-stp_10.42.42.5(pid=7628): stdout: | (launched: 2022-12-10_01:15:51.166362) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:15:52.661326 run osmo-stp_10.42.42.5(pid=7628): stderr: | 20221210011551337 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011551338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011551338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011551338 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011551339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011551339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011551339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:15:52.795620 run osmo-stp_10.42.42.5(pid=7628): stdout: | (launched: 2022-12-10_01:15:51.166362) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:15:52.922769 run osmo-stp_10.42.42.5(pid=7628): stderr: | 20221210011551337 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011551338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011551338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011551338 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011551339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011551339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011551339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:15:53.075075 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=7628): Process ended prematurely: osmo-stp_10.42.42.5(pid=7628) [trial-2367↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7628)] [trial-2367↪sms:trx-umtrx↪mo_mt_sms.py:16] 01:15:53.083910 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 01:15:53.111417 run osmo-hlr_10.42.42.2(pid=7625): ERR: Terminated: ERROR {rc=237} [trial-2367↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7625)] 01:15:53.161487 run osmo-hlr_10.42.42.2(pid=7625): stdout: | (launched: 2022-12-10_01:15:50.218964) 01:15:53.213321 run osmo-hlr_10.42.42.2(pid=7625): stderr: | 20221210011550395 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011550395 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011550395 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011550395 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011550395 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011550395 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011550408 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011550418 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011550418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011550418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:15:53.285375 run osmo-msc_10.42.42.6(pid=7631): ERR: Terminated: ERROR {rc=2} [trial-2367↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7631)] 01:15:53.335183 run osmo-msc_10.42.42.6(pid=7631): stdout: | (launched: 2022-12-10_01:15:52.148849) 01:15:53.386579 run osmo-msc_10.42.42.6(pid=7631): stderr: | 20221210011552469 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210011552469 DLGLOBAL DEBUG validating counter group 0x7f944b57cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210011552469 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210011552470 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210011552470 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210011552470 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210011552472 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210011552472 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210011552472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210011552472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:15:53.438567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7624): Terminating (SIGTERM) 01:15:53.480135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7627): Terminating (SIGTERM) 01:15:53.522135 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7630): Terminating (SIGTERM) 01:15:53.564464 --- ParallelTerminationStrategy: PID 7624 died... 01:15:53.584477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7624): Terminated: ok {rc=0} 01:15:53.630679 --- ParallelTerminationStrategy: PID 7627 died... 01:15:53.650040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7627): Terminated: ok {rc=0} 01:15:53.695999 --- ParallelTerminationStrategy: PID 7630 died... 01:15:53.715424 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7630): Terminated: ok {rc=0} 01:15:53.802802 bus /sierra_3: Setting Powered False 01:15:54.902443 bus /sierra_3: Setting Powered False 01:15:56.018787 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 01:15:57.251052 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:15:57.255089 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 01:15:57.288172 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 01:15:57.295162 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 01:15:57.332162 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 01:15:57.365967 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 01:15:57.372926 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 01:15:57.889963 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2367 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 01:15:57.895069 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 01:15:57.905935 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 01:15:57.953359 tst assert_extension.py: using LAC 24970 01:15:58.073125 tst assert_extension.py: using RAC 235 01:15:58.190109 tst assert_extension.py: using CellId 24970 01:15:58.309665 tst assert_extension.py: using BVCI 24971 01:15:58.417993 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 01:15:58.533853 tst assert_extension.py:10: start nitb and bts... 01:15:58.749985 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:15:59.403959 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7636): Launched 01:15:59.725154 run osmo-nitb_10.42.42.2(pid=7637): Launched 01:15:59.902264 run osmo-nitb_10.42.42.2(pid=7637): ERR: Terminated: ERROR {rc=2} [trial-2367↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7637)] 01:16:00.044793 run osmo-nitb_10.42.42.2(pid=7637): stdout: | (launched: 2022-12-10_01:15:59.666338) 01:16:00.189238 run osmo-nitb_10.42.42.2(pid=7637): stderr: | (launched: 2022-12-10_01:15:59.713903) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:16:00.333479 run osmo-nitb_10.42.42.2(pid=7637): stdout: | (launched: 2022-12-10_01:15:59.666338) 01:16:00.472011 run osmo-nitb_10.42.42.2(pid=7637): stderr: | (launched: 2022-12-10_01:15:59.713903) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=7637): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7637) [trial-2367↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7637)] 01:16:00.845660 tst osmo-nitb_10.42.42.2(pid=7637): stdout: | (launched: 2022-12-10_01:15:59.666338) 01:16:00.999512 tst osmo-nitb_10.42.42.2(pid=7637): stderr: | (launched: 2022-12-10_01:15:59.713903) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:16:01.158233 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=7637): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7637) [trial-2367↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7637)] [trial-2367↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 01:16:01.167664 tst assert_extension.py:12: Test FAILED (3.3 sec) 01:16:01.175282 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7636): Terminating (SIGTERM) 01:16:01.386256 --- ParallelTerminationStrategy: PID 7636 died... 01:16:01.406259 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7636): Terminated: ok {rc=0} 01:16:01.495505 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 ussd:trx-umtrx --------------------------------------------------------------------- 01:16:02.678045 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:16:02.682676 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 01:16:02.717804 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 01:16:02.744938 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 01:16:02.782406 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 01:16:02.815813 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 01:16:02.843134 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 01:16:03.370618 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2367 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 01:16:03.376009 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:16:03.387136 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 01:16:03.435800 tst assert_extension.py: using LAC 24971 01:16:03.553431 tst assert_extension.py: using RAC 236 01:16:03.680164 tst assert_extension.py: using CellId 24971 01:16:03.804099 tst assert_extension.py: using BVCI 24972 01:16:03.920330 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:16:03.931484 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:16:03.942604 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:16:03.953669 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:16:03.964561 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:16:03.975583 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 01:16:04.088222 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:16:04.553236 run create_hlr_db(pid=7641): Launched 01:16:04.669854 bus /sierra_2: Setting Powered False 01:16:05.729424 run create_hlr_db(pid=7641): Terminated: ok {rc=0} 01:16:06.167882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7643): Launched 01:16:06.490228 run osmo-hlr_10.42.42.2(pid=7644): Launched 01:16:06.615454 run osmo-stp_10.42.42.5: Starting osmo-stp 01:16:07.172272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7646): Launched 01:16:07.492888 run osmo-stp_10.42.42.5(pid=7647): Launched 01:16:07.617116 run osmo-msc_10.42.42.6: Starting osmo-msc 01:16:08.197624 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7649): Launched 01:16:08.519851 run osmo-msc_10.42.42.6(pid=7650): Launched 01:16:08.701276 run osmo-stp_10.42.42.5(pid=7647): ERR: Terminated: ERROR {rc=1} [trial-2367↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7647)] 01:16:08.836388 run osmo-stp_10.42.42.5(pid=7647): stdout: | (launched: 2022-12-10_01:16:07.433806) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:16:08.971770 run osmo-stp_10.42.42.5(pid=7647): stderr: | 20221210011607627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011607627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011607627 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011607628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011607630 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011607630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011607630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:16:09.106548 run osmo-stp_10.42.42.5(pid=7647): stdout: | (launched: 2022-12-10_01:16:07.433806) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:16:09.233631 run osmo-stp_10.42.42.5(pid=7647): stderr: | 20221210011607627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011607627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011607627 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011607628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011607630 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011607630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011607630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:16:09.385747 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=7647): Process ended prematurely: osmo-stp_10.42.42.5(pid=7647) [trial-2367↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7647)] [trial-2367↪ussd:trx-umtrx↪assert_extension.py:17] 01:16:09.394975 tst assert_extension.py:17: Test FAILED (6.0 sec) 01:16:09.422441 run osmo-hlr_10.42.42.2(pid=7644): ERR: Terminated: ERROR {rc=237} [trial-2367↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7644)] 01:16:09.472144 run osmo-hlr_10.42.42.2(pid=7644): stdout: | (launched: 2022-12-10_01:16:06.431474) 01:16:09.524220 run osmo-hlr_10.42.42.2(pid=7644): stderr: | 20221210011606632 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011606632 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011606632 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011606632 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011606632 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011606632 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011606643 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011606652 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011606652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011606652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:16:09.596619 run osmo-msc_10.42.42.6(pid=7650): ERR: Terminated: ERROR {rc=2} [trial-2367↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7650)] 01:16:09.646481 run osmo-msc_10.42.42.6(pid=7650): stdout: | (launched: 2022-12-10_01:16:08.461088) 01:16:09.698079 run osmo-msc_10.42.42.6(pid=7650): stderr: | 20221210011608781 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210011608782 DLGLOBAL DEBUG validating counter group 0x7fa892d92c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210011608782 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210011608782 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210011608782 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210011608782 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210011608784 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210011608784 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210011608784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210011608784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:16:09.750242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7643): Terminating (SIGTERM) 01:16:09.791865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7646): Terminating (SIGTERM) 01:16:09.834098 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7649): Terminating (SIGTERM) 01:16:09.876131 --- ParallelTerminationStrategy: PID 7643 died... 01:16:09.896043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7643): Terminated: ok {rc=0} 01:16:09.942559 --- ParallelTerminationStrategy: PID 7646 died... 01:16:09.962083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7646): Terminated: ok {rc=0} 01:16:10.007722 --- ParallelTerminationStrategy: PID 7649 died... 01:16:10.027292 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7649): Terminated: ok {rc=0} 01:16:10.114795 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 01:16:11.327256 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:16:11.334927 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 01:16:11.368320 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 01:16:11.395593 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 01:16:11.450221 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 01:16:11.484087 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 01:16:11.511442 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 01:16:12.061983 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 01:16:12.114951 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:12.126154 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:16:12.195635 tst mo_mt_call.py: using LAC 24972 01:16:12.325380 tst mo_mt_call.py: using RAC 237 01:16:12.451978 tst mo_mt_call.py: using CellId 24972 01:16:12.572165 tst mo_mt_call.py: using BVCI 24973 01:16:12.684026 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:12.695308 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:12.706481 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:12.717384 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:12.728775 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:12.739960 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:16:12.858337 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:16:12.976053 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:16:13.449428 run create_hlr_db(pid=7655): Launched 01:16:13.567358 bus /sierra_2: Setting Powered False 01:16:14.628076 run create_hlr_db(pid=7655): Terminated: ok {rc=0} 01:16:15.072209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7657): Launched 01:16:15.401155 run osmo-hlr_10.42.42.2(pid=7658): Launched 01:16:15.527087 run osmo-stp_10.42.42.5: Starting osmo-stp 01:16:16.096208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7660): Launched 01:16:16.456609 run osmo-stp_10.42.42.5(pid=7661): Launched 01:16:16.697174 run osmo-msc_10.42.42.6: Starting osmo-msc 01:16:17.394502 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7663): Launched 01:16:17.705118 run osmo-msc_10.42.42.6(pid=7664): Launched 01:16:17.877248 run osmo-stp_10.42.42.5(pid=7661): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7661)] 01:16:18.006961 run osmo-stp_10.42.42.5(pid=7661): stdout: | (launched: 2022-12-10_01:16:16.398422) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:16:18.135777 run osmo-stp_10.42.42.5(pid=7661): stderr: | 20221210011616732 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011616739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011616740 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011616740 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011616741 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011616741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011616741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:16:18.262617 run osmo-stp_10.42.42.5(pid=7661): stdout: | (launched: 2022-12-10_01:16:16.398422) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:16:18.384228 run osmo-stp_10.42.42.5(pid=7661): stderr: | 20221210011616732 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011616739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011616740 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011616740 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011616741 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011616741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011616741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:16:18.530327 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7661): Process ended prematurely: osmo-stp_10.42.42.5(pid=7661) [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7661)] [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 01:16:18.539318 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 01:16:18.565862 run osmo-hlr_10.42.42.2(pid=7658): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7658)] 01:16:18.614204 run osmo-hlr_10.42.42.2(pid=7658): stdout: | (launched: 2022-12-10_01:16:15.340022) 01:16:18.663655 run osmo-hlr_10.42.42.2(pid=7658): stderr: | 20221210011615538 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011615538 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011615538 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011615538 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011615538 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011615539 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011615550 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011615558 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011615559 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011615559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:16:18.732741 run osmo-msc_10.42.42.6(pid=7664): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7664)] 01:16:18.780574 run osmo-msc_10.42.42.6(pid=7664): stdout: | (launched: 2022-12-10_01:16:17.648157) 01:16:18.830053 run osmo-msc_10.42.42.6(pid=7664): stderr: | 20221210011617920 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210011617921 DLGLOBAL DEBUG validating counter group 0x7f2265af1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210011617921 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210011617921 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210011617921 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210011617921 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210011617923 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210011617923 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210011617923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210011617923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:16:18.879973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7657): Terminating (SIGTERM) 01:16:18.919758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7660): Terminating (SIGTERM) 01:16:18.959871 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7663): Terminating (SIGTERM) 01:16:19.000356 --- ParallelTerminationStrategy: PID 7657 died... 01:16:19.019671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7657): Terminated: ok {rc=0} 01:16:19.063534 --- ParallelTerminationStrategy: PID 7660 died... 01:16:19.082305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7660): Terminated: ok {rc=0} 01:16:19.126643 --- ParallelTerminationStrategy: PID 7663 died... 01:16:19.145633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7663): Terminated: ok {rc=0} 01:16:19.232471 bus /sierra_3: Setting Powered False 01:16:20.332870 bus /sierra_3: Setting Powered False 01:16:21.449228 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 01:16:22.597711 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:22.609637 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:16:22.679340 tst mo_mt_call_osmux.py: using LAC 24973 01:16:22.798780 tst mo_mt_call_osmux.py: using RAC 238 01:16:22.919548 tst mo_mt_call_osmux.py: using CellId 24973 01:16:23.040586 tst mo_mt_call_osmux.py: using BVCI 24974 01:16:23.152259 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:23.163522 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:23.174588 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:23.185518 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:23.196725 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:23.208189 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:16:23.323013 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:16:23.444203 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:16:23.950552 run create_hlr_db(pid=7666): Launched 01:16:24.086056 bus /sierra_2: Setting Powered False 01:16:25.150393 run create_hlr_db(pid=7666): Terminated: ok {rc=0} 01:16:25.584688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7668): Launched 01:16:25.890541 run osmo-hlr_10.42.42.2(pid=7669): Launched 01:16:26.007434 run osmo-stp_10.42.42.5: Starting osmo-stp 01:16:26.544728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7671): Launched 01:16:26.850344 run osmo-stp_10.42.42.5(pid=7672): Launched 01:16:26.967854 run osmo-msc_10.42.42.6: Starting osmo-msc 01:16:27.520508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7674): Launched 01:16:27.826535 run osmo-msc_10.42.42.6(pid=7675): Launched 01:16:27.998414 run osmo-stp_10.42.42.5(pid=7672): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7672)] 01:16:28.128283 run osmo-stp_10.42.42.5(pid=7672): stdout: | (launched: 2022-12-10_01:16:26.794409) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:16:28.257599 run osmo-stp_10.42.42.5(pid=7672): stderr: | 20221210011626964 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011626964 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011626965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011626965 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011626967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011626967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011626968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:16:28.384413 run osmo-stp_10.42.42.5(pid=7672): stdout: | (launched: 2022-12-10_01:16:26.794409) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:16:28.505878 run osmo-stp_10.42.42.5(pid=7672): stderr: | 20221210011626964 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011626964 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011626965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011626965 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011626967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011626967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011626968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:16:28.651498 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7672): Process ended prematurely: osmo-stp_10.42.42.5(pid=7672) [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7672)] [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 01:16:28.660415 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 01:16:28.687275 run osmo-hlr_10.42.42.2(pid=7669): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7669)] 01:16:28.735241 run osmo-hlr_10.42.42.2(pid=7669): stdout: | (launched: 2022-12-10_01:16:25.834700) 01:16:28.784501 run osmo-hlr_10.42.42.2(pid=7669): stderr: | 20221210011626010 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011626010 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011626010 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011626010 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011626010 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011626010 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011626024 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011626034 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011626035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011626035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:16:28.853799 run osmo-msc_10.42.42.6(pid=7675): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7675)] 01:16:28.901291 run osmo-msc_10.42.42.6(pid=7675): stdout: | (launched: 2022-12-10_01:16:27.769964) 01:16:28.950484 run osmo-msc_10.42.42.6(pid=7675): stderr: | 20221210011628043 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210011628043 DLGLOBAL DEBUG validating counter group 0x7f9defe6bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210011628043 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210011628043 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210011628044 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210011628044 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210011628045 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210011628046 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210011628046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210011628046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:16:29.000162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7668): Terminating (SIGTERM) 01:16:29.039930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7671): Terminating (SIGTERM) 01:16:29.079631 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7674): Terminating (SIGTERM) 01:16:29.119638 --- ParallelTerminationStrategy: PID 7668 died... 01:16:29.138701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7668): Terminated: ok {rc=0} 01:16:29.182753 --- ParallelTerminationStrategy: PID 7671 died... 01:16:29.201499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7671): Terminated: ok {rc=0} 01:16:29.245571 --- ParallelTerminationStrategy: PID 7674 died... 01:16:29.263855 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7674): Terminated: ok {rc=0} 01:16:29.348584 bus /sierra_3: Setting Powered False 01:16:30.447664 bus /sierra_3: Setting Powered False 01:16:31.567067 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 01:16:32.819460 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:16:32.826305 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 01:16:32.859402 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 01:16:32.885781 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 01:16:32.937541 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 01:16:32.970393 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 01:16:32.997709 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 01:16:33.546184 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 01:16:33.596187 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:16:33.607322 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:16:33.675916 tst mo_mt_call.py: using LAC 24974 01:16:33.797151 tst mo_mt_call.py: using RAC 239 01:16:33.927200 tst mo_mt_call.py: using CellId 24974 01:16:34.057390 tst mo_mt_call.py: using BVCI 24975 01:16:34.176507 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:16:34.188210 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:16:34.199796 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:16:34.211935 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:16:34.224216 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:16:34.236335 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:16:34.351992 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:16:34.471729 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:16:34.977954 run create_hlr_db(pid=7680): Launched 01:16:35.112818 bus /sierra_2: Setting Powered False 01:16:36.177140 run create_hlr_db(pid=7680): Terminated: ok {rc=0} 01:16:36.629742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7682): Launched 01:16:36.956092 run osmo-hlr_10.42.42.2(pid=7683): Launched 01:16:37.080687 run osmo-stp_10.42.42.5: Starting osmo-stp 01:16:37.647156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7685): Launched 01:16:37.972465 run osmo-stp_10.42.42.5(pid=7686): Launched 01:16:38.096699 run osmo-msc_10.42.42.6: Starting osmo-msc 01:16:38.684193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7688): Launched 01:16:39.008585 run osmo-msc_10.42.42.6(pid=7689): Launched 01:16:39.189522 run osmo-stp_10.42.42.5(pid=7686): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7686)] 01:16:39.327240 run osmo-stp_10.42.42.5(pid=7686): stdout: | (launched: 2022-12-10_01:16:37.913352) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:16:39.464277 run osmo-stp_10.42.42.5(pid=7686): stderr: | 20221210011638107 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011638108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011638108 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011638108 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011638109 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011638109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011638109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:16:39.601025 run osmo-stp_10.42.42.5(pid=7686): stdout: | (launched: 2022-12-10_01:16:37.913352) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:16:39.730350 run osmo-stp_10.42.42.5(pid=7686): stderr: | 20221210011638107 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011638108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011638108 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011638108 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011638109 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011638109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011638109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:16:39.884897 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7686): Process ended prematurely: osmo-stp_10.42.42.5(pid=7686) [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7686)] [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 01:16:39.894446 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 01:16:39.922274 run osmo-hlr_10.42.42.2(pid=7683): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7683)] 01:16:39.972406 run osmo-hlr_10.42.42.2(pid=7683): stdout: | (launched: 2022-12-10_01:16:36.897023) 01:16:40.024738 run osmo-hlr_10.42.42.2(pid=7683): stderr: | 20221210011637095 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011637095 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011637095 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011637095 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011637095 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011637095 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011637109 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011637117 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011637117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011637117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:16:40.097182 run osmo-msc_10.42.42.6(pid=7689): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7689)] 01:16:40.147643 run osmo-msc_10.42.42.6(pid=7689): stdout: | (launched: 2022-12-10_01:16:38.949265) 01:16:40.199174 run osmo-msc_10.42.42.6(pid=7689): stderr: | 20221210011639274 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210011639274 DLGLOBAL DEBUG validating counter group 0x7f7e85428c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210011639274 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210011639274 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210011639274 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210011639274 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210011639276 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210011639276 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210011639277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210011639277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:16:40.251172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7682): Terminating (SIGTERM) 01:16:40.292491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7685): Terminating (SIGTERM) 01:16:40.333923 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7688): Terminating (SIGTERM) 01:16:40.375693 --- ParallelTerminationStrategy: PID 7682 died... 01:16:40.395221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7682): Terminated: ok {rc=0} 01:16:40.441266 --- ParallelTerminationStrategy: PID 7685 died... 01:16:40.460683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7685): Terminated: ok {rc=0} 01:16:40.506779 --- ParallelTerminationStrategy: PID 7688 died... 01:16:40.526666 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7688): Terminated: ok {rc=0} 01:16:40.615433 bus /sierra_3: Setting Powered False 01:16:41.714390 bus /sierra_3: Setting Powered False 01:16:42.831721 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 01:16:43.981077 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:16:43.993607 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:16:44.065592 tst mo_mt_call_osmux.py: using LAC 24975 01:16:44.195729 tst mo_mt_call_osmux.py: using RAC 240 01:16:44.323422 tst mo_mt_call_osmux.py: using CellId 24975 01:16:44.452374 tst mo_mt_call_osmux.py: using BVCI 24976 01:16:44.572721 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:16:44.584561 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:16:44.595977 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:16:44.607425 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:16:44.618954 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:16:44.630449 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:16:44.746966 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:16:44.865376 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:16:45.341876 run create_hlr_db(pid=7691): Launched 01:16:45.461649 bus /sierra_2: Setting Powered False 01:16:46.520244 run create_hlr_db(pid=7691): Terminated: ok {rc=0} 01:16:47.004401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7693): Launched 01:16:47.345165 run osmo-hlr_10.42.42.2(pid=7694): Launched 01:16:47.472089 run osmo-stp_10.42.42.5: Starting osmo-stp 01:16:48.035261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7696): Launched 01:16:48.363978 run osmo-stp_10.42.42.5(pid=7697): Launched 01:16:48.487929 run osmo-msc_10.42.42.6: Starting osmo-msc 01:16:49.079434 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7699): Launched 01:16:49.408114 run osmo-msc_10.42.42.6(pid=7700): Launched 01:16:49.591057 run osmo-stp_10.42.42.5(pid=7697): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7697)] 01:16:49.727914 run osmo-stp_10.42.42.5(pid=7697): stdout: | (launched: 2022-12-10_01:16:48.304377) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:16:49.865416 run osmo-stp_10.42.42.5(pid=7697): stderr: | 20221210011648498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011648498 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011648499 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011648499 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011648499 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011648500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011648500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:16:50.001747 run osmo-stp_10.42.42.5(pid=7697): stdout: | (launched: 2022-12-10_01:16:48.304377) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:16:50.131424 run osmo-stp_10.42.42.5(pid=7697): stderr: | 20221210011648498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011648498 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011648499 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011648499 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011648499 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011648500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011648500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:16:50.286673 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7697): Process ended prematurely: osmo-stp_10.42.42.5(pid=7697) [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7697)] [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 01:16:50.296213 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 01:16:50.324317 run osmo-hlr_10.42.42.2(pid=7694): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7694)] 01:16:50.374773 run osmo-hlr_10.42.42.2(pid=7694): stdout: | (launched: 2022-12-10_01:16:47.285537) 01:16:50.427125 run osmo-hlr_10.42.42.2(pid=7694): stderr: | 20221210011647487 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011647487 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011647487 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011647487 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011647487 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011647487 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011647499 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011647509 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011647510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011647510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:16:50.499661 run osmo-msc_10.42.42.6(pid=7700): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7700)] 01:16:50.550383 run osmo-msc_10.42.42.6(pid=7700): stdout: | (launched: 2022-12-10_01:16:49.348082) 01:16:50.602485 run osmo-msc_10.42.42.6(pid=7700): stderr: | 20221210011649670 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210011649670 DLGLOBAL DEBUG validating counter group 0x7f2082555c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210011649670 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210011649670 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210011649671 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210011649671 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210011649672 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210011649673 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210011649673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210011649673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:16:50.654590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7693): Terminating (SIGTERM) 01:16:50.696858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7696): Terminating (SIGTERM) 01:16:50.738748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7699): Terminating (SIGTERM) 01:16:50.780735 --- ParallelTerminationStrategy: PID 7693 died... 01:16:50.800832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7693): Terminated: ok {rc=0} 01:16:50.847226 --- ParallelTerminationStrategy: PID 7696 died... 01:16:50.866766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7696): Terminated: ok {rc=0} 01:16:50.912849 --- ParallelTerminationStrategy: PID 7699 died... 01:16:50.932814 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7699): Terminated: ok {rc=0} 01:16:51.020807 bus /sierra_3: Setting Powered False 01:16:52.119602 bus /sierra_3: Setting Powered False 01:16:53.238616 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 01:16:54.502186 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:16:54.510449 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 01:16:54.543906 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 01:16:54.570860 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 01:16:54.622589 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 01:16:54.655909 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 01:16:54.683074 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 01:16:55.237389 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 01:16:55.289356 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:16:55.300755 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:16:55.369463 tst mo_mt_call.py: using LAC 24976 01:16:55.496553 tst mo_mt_call.py: using RAC 241 01:16:55.622565 tst mo_mt_call.py: using CellId 24976 01:16:55.751801 tst mo_mt_call.py: using BVCI 24977 01:16:55.869615 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:16:55.881091 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:16:55.892376 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:16:55.903815 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:16:55.915194 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:16:55.926480 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:16:56.043436 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:16:56.160051 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:16:56.634851 run create_hlr_db(pid=7705): Launched 01:16:56.752790 bus /sierra_2: Setting Powered False 01:16:57.814074 run create_hlr_db(pid=7705): Terminated: ok {rc=0} 01:16:58.238970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7707): Launched 01:16:58.547114 run osmo-hlr_10.42.42.2(pid=7708): Launched 01:16:58.664610 run osmo-stp_10.42.42.5: Starting osmo-stp 01:16:59.205449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7710): Launched 01:16:59.515211 run osmo-stp_10.42.42.5(pid=7711): Launched 01:16:59.634490 run osmo-msc_10.42.42.6: Starting osmo-msc 01:17:00.188003 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7713): Launched 01:17:00.496555 run osmo-msc_10.42.42.6(pid=7714): Launched 01:17:00.673747 run osmo-stp_10.42.42.5(pid=7711): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7711)] 01:17:00.803742 run osmo-stp_10.42.42.5(pid=7711): stdout: | (launched: 2022-12-10_01:16:59.458146) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:00.974414 run osmo-stp_10.42.42.5(pid=7711): stderr: | 20221210011659629 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011659629 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011659629 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011659630 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011659632 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011659632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011659632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:01.105879 run osmo-stp_10.42.42.5(pid=7711): stdout: | (launched: 2022-12-10_01:16:59.458146) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:01.231341 run osmo-stp_10.42.42.5(pid=7711): stderr: | 20221210011659629 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011659629 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011659629 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011659630 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011659632 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011659632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011659632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:01.381966 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7711): Process ended prematurely: osmo-stp_10.42.42.5(pid=7711) [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7711)] [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 01:17:01.391936 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:17:01.422325 run osmo-hlr_10.42.42.2(pid=7708): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7708)] 01:17:01.472922 run osmo-hlr_10.42.42.2(pid=7708): stdout: | (launched: 2022-12-10_01:16:58.490931) 01:17:01.525268 run osmo-hlr_10.42.42.2(pid=7708): stderr: | 20221210011658668 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011658668 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011658668 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011658668 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011658668 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011658668 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011658680 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011658689 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011658689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011658689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:17:01.597789 run osmo-msc_10.42.42.6(pid=7714): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7714)] 01:17:01.648656 run osmo-msc_10.42.42.6(pid=7714): stdout: | (launched: 2022-12-10_01:17:00.439722) 01:17:01.705428 run osmo-msc_10.42.42.6(pid=7714): stderr: | 20221210011700715 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210011700715 DLGLOBAL DEBUG validating counter group 0x7f7f2de04c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210011700715 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210011700715 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210011700715 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210011700715 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210011700717 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210011700717 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210011700718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210011700718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:17:01.766151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7707): Terminating (SIGTERM) 01:17:01.808927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7710): Terminating (SIGTERM) 01:17:01.851352 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7713): Terminating (SIGTERM) 01:17:01.894209 --- ParallelTerminationStrategy: PID 7707 died... 01:17:01.913892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7707): Terminated: ok {rc=0} 01:17:01.961916 --- ParallelTerminationStrategy: PID 7710 died... 01:17:01.981484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7710): Terminated: ok {rc=0} 01:17:02.029150 --- ParallelTerminationStrategy: PID 7713 died... 01:17:02.048680 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7713): Terminated: ok {rc=0} 01:17:02.137393 bus /sierra_3: Setting Powered False 01:17:03.237083 bus /sierra_3: Setting Powered False 01:17:04.353470 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 01:17:05.500894 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:17:05.513082 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:17:05.586505 tst mo_mt_call_osmux.py: using LAC 24977 01:17:05.706303 tst mo_mt_call_osmux.py: using RAC 242 01:17:05.824588 tst mo_mt_call_osmux.py: using CellId 24977 01:17:05.942556 tst mo_mt_call_osmux.py: using BVCI 24978 01:17:06.055293 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:17:06.066664 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:17:06.077608 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:17:06.088890 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:17:06.100871 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:17:06.112297 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:17:06.228477 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:17:06.348001 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:17:06.822964 run create_hlr_db(pid=7719): Launched 01:17:06.940609 bus /sierra_2: Setting Powered False 01:17:08.001708 run create_hlr_db(pid=7719): Terminated: ok {rc=0} 01:17:08.447633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7721): Launched 01:17:08.775129 run osmo-hlr_10.42.42.2(pid=7722): Launched 01:17:08.902261 run osmo-stp_10.42.42.5: Starting osmo-stp 01:17:09.463137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7724): Launched 01:17:09.791955 run osmo-stp_10.42.42.5(pid=7725): Launched 01:17:09.917175 run osmo-msc_10.42.42.6: Starting osmo-msc 01:17:10.507778 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7727): Launched 01:17:10.837591 run osmo-msc_10.42.42.6(pid=7728): Launched 01:17:11.022392 run osmo-stp_10.42.42.5(pid=7725): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7725)] 01:17:11.160868 run osmo-stp_10.42.42.5(pid=7725): stdout: | (launched: 2022-12-10_01:17:09.731978) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:11.298758 run osmo-stp_10.42.42.5(pid=7725): stderr: | 20221210011709925 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011709925 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011709925 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011709926 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011709926 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011709926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011709926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:11.435379 run osmo-stp_10.42.42.5(pid=7725): stdout: | (launched: 2022-12-10_01:17:09.731978) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:11.566756 run osmo-stp_10.42.42.5(pid=7725): stderr: | 20221210011709925 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011709925 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011709925 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011709926 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011709926 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011709926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011709926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:11.722967 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7725): Process ended prematurely: osmo-stp_10.42.42.5(pid=7725) [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7725)] [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 01:17:11.732473 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 01:17:11.760809 run osmo-hlr_10.42.42.2(pid=7722): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7722)] 01:17:11.811456 run osmo-hlr_10.42.42.2(pid=7722): stdout: | (launched: 2022-12-10_01:17:08.715536) 01:17:11.863772 run osmo-hlr_10.42.42.2(pid=7722): stderr: | 20221210011708915 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011708915 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011708915 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011708915 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011708915 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011708915 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011708927 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011708936 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011708936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011708936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:17:11.936883 run osmo-msc_10.42.42.6(pid=7728): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7728)] 01:17:11.987349 run osmo-msc_10.42.42.6(pid=7728): stdout: | (launched: 2022-12-10_01:17:10.777663) 01:17:12.039667 run osmo-msc_10.42.42.6(pid=7728): stderr: | 20221210011711098 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210011711099 DLGLOBAL DEBUG validating counter group 0x7fb067251c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210011711099 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210011711099 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210011711099 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210011711099 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210011711101 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210011711101 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210011711101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210011711102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:17:12.092376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7721): Terminating (SIGTERM) 01:17:12.134700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7724): Terminating (SIGTERM) 01:17:12.177053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7727): Terminating (SIGTERM) 01:17:12.219626 --- ParallelTerminationStrategy: PID 7721 died... 01:17:12.239805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7721): Terminated: ok {rc=0} 01:17:12.286056 --- ParallelTerminationStrategy: PID 7724 died... 01:17:12.305816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7724): Terminated: ok {rc=0} 01:17:12.352102 --- ParallelTerminationStrategy: PID 7727 died... 01:17:12.371761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7727): Terminated: ok {rc=0} 01:17:12.460812 bus /sierra_3: Setting Powered False 01:17:13.559947 bus /sierra_3: Setting Powered False 01:17:14.675595 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 01:17:15.937334 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:17:15.944551 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 01:17:15.994491 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 01:17:16.023770 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 01:17:16.079420 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 01:17:16.122630 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 01:17:16.157445 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 01:17:16.717501 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 01:17:16.788526 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:17:16.804218 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 01:17:16.889226 tst mo_mt_call.py: using LAC 24978 01:17:17.022982 tst mo_mt_call.py: using RAC 243 01:17:17.189196 tst mo_mt_call.py: using CellId 24978 01:17:17.333292 tst mo_mt_call.py: using BVCI 24979 01:17:17.457352 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:17:17.468837 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:17:17.480282 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:17:17.491822 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:17:17.503488 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:17:17.514782 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:17:17.637129 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:17:17.756873 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:17:18.233813 run create_hlr_db(pid=7733): Launched 01:17:18.352687 bus /sierra_2: Setting Powered False 01:17:19.414354 run create_hlr_db(pid=7733): Terminated: ok {rc=0} 01:17:19.861206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7735): Launched 01:17:20.187918 run osmo-hlr_10.42.42.2(pid=7736): Launched 01:17:20.313090 run osmo-stp_10.42.42.5: Starting osmo-stp 01:17:20.878909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7738): Launched 01:17:21.206510 run osmo-stp_10.42.42.5(pid=7739): Launched 01:17:21.332333 run osmo-msc_10.42.42.6: Starting osmo-msc 01:17:21.927065 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7741): Launched 01:17:22.256742 run osmo-msc_10.42.42.6(pid=7742): Launched 01:17:22.439662 run osmo-stp_10.42.42.5(pid=7739): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7739)] 01:17:22.577600 run osmo-stp_10.42.42.5(pid=7739): stdout: | (launched: 2022-12-10_01:17:21.147083) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:22.715567 run osmo-stp_10.42.42.5(pid=7739): stderr: | 20221210011721341 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011721341 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011721341 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011721342 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011721342 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011721342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011721342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:22.851917 run osmo-stp_10.42.42.5(pid=7739): stdout: | (launched: 2022-12-10_01:17:21.147083) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:22.982183 run osmo-stp_10.42.42.5(pid=7739): stderr: | 20221210011721341 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011721341 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011721341 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011721342 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011721342 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011721342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011721342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:23.138225 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7739): Process ended prematurely: osmo-stp_10.42.42.5(pid=7739) [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7739)] [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 01:17:23.147994 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 01:17:23.176646 run osmo-hlr_10.42.42.2(pid=7736): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7736)] 01:17:23.227735 run osmo-hlr_10.42.42.2(pid=7736): stdout: | (launched: 2022-12-10_01:17:20.128480) 01:17:23.280433 run osmo-hlr_10.42.42.2(pid=7736): stderr: | 20221210011720329 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011720329 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011720329 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011720329 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011720329 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011720329 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011720342 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011720350 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011720350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011720350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:17:23.353738 run osmo-msc_10.42.42.6(pid=7742): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7742)] 01:17:23.404598 run osmo-msc_10.42.42.6(pid=7742): stdout: | (launched: 2022-12-10_01:17:22.196635) 01:17:23.457250 run osmo-msc_10.42.42.6(pid=7742): stderr: | 20221210011722519 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210011722519 DLGLOBAL DEBUG validating counter group 0x7f636db7dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210011722519 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210011722519 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210011722520 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210011722520 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210011722522 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210011722523 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210011722523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210011722523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:17:23.510209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7735): Terminating (SIGTERM) 01:17:23.552872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7738): Terminating (SIGTERM) 01:17:23.595177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7741): Terminating (SIGTERM) 01:17:23.638071 --- ParallelTerminationStrategy: PID 7735 died... 01:17:23.658629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7735): Terminated: ok {rc=0} 01:17:23.705923 --- ParallelTerminationStrategy: PID 7738 died... 01:17:23.725831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7738): Terminated: ok {rc=0} 01:17:23.772570 --- ParallelTerminationStrategy: PID 7741 died... 01:17:23.792510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7741): Terminated: ok {rc=0} 01:17:23.882212 bus /sierra_3: Setting Powered False 01:17:24.982842 bus /sierra_3: Setting Powered False 01:17:26.100711 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 01:17:27.251910 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:17:27.264468 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 01:17:27.335796 tst mo_mt_call_osmux.py: using LAC 24979 01:17:27.457883 tst mo_mt_call_osmux.py: using RAC 244 01:17:27.578904 tst mo_mt_call_osmux.py: using CellId 24979 01:17:27.699956 tst mo_mt_call_osmux.py: using BVCI 24980 01:17:27.810099 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:17:27.821348 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:17:27.832408 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:17:27.843651 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:17:27.854847 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:17:27.865938 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:17:27.983257 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:17:28.104235 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:17:28.609327 run create_hlr_db(pid=7744): Launched 01:17:28.743789 bus /sierra_2: Setting Powered False 01:17:29.808799 run create_hlr_db(pid=7744): Terminated: ok {rc=0} 01:17:30.260408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7746): Launched 01:17:30.586324 run osmo-hlr_10.42.42.2(pid=7747): Launched 01:17:30.711815 run osmo-stp_10.42.42.5: Starting osmo-stp 01:17:31.357807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7749): Launched 01:17:31.679944 run osmo-stp_10.42.42.5(pid=7750): Launched 01:17:31.827091 run osmo-msc_10.42.42.6: Starting osmo-msc 01:17:32.544624 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7752): Launched 01:17:32.850892 run osmo-msc_10.42.42.6(pid=7753): Launched 01:17:33.021972 run osmo-stp_10.42.42.5(pid=7750): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7750)] 01:17:33.150476 run osmo-stp_10.42.42.5(pid=7750): stdout: | (launched: 2022-12-10_01:17:31.622080) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:33.279271 run osmo-stp_10.42.42.5(pid=7750): stderr: | 20221210011732015 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011732015 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011732016 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011732016 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011732016 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011732021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011732021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:33.405709 run osmo-stp_10.42.42.5(pid=7750): stdout: | (launched: 2022-12-10_01:17:31.622080) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:33.526998 run osmo-stp_10.42.42.5(pid=7750): stderr: | 20221210011732015 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011732015 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011732016 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011732016 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011732016 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011732021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011732021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:33.672118 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7750): Process ended prematurely: osmo-stp_10.42.42.5(pid=7750) [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7750)] [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 01:17:33.681169 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 01:17:33.708511 run osmo-hlr_10.42.42.2(pid=7747): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7747)] 01:17:33.756643 run osmo-hlr_10.42.42.2(pid=7747): stdout: | (launched: 2022-12-10_01:17:30.527062) 01:17:33.806629 run osmo-hlr_10.42.42.2(pid=7747): stderr: | 20221210011730726 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011730727 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011730727 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011730727 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011730727 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011730727 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011730739 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011730747 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011730748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011730748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:17:33.875827 run osmo-msc_10.42.42.6(pid=7753): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7753)] 01:17:33.923768 run osmo-msc_10.42.42.6(pid=7753): stdout: | (launched: 2022-12-10_01:17:32.794277) 01:17:33.973161 run osmo-msc_10.42.42.6(pid=7753): stderr: | 20221210011733067 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210011733067 DLGLOBAL DEBUG validating counter group 0x7fee77f59c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210011733067 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210011733067 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210011733068 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210011733068 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210011733069 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210011733070 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210011733070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210011733070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:17:34.023198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7746): Terminating (SIGTERM) 01:17:34.063109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7749): Terminating (SIGTERM) 01:17:34.103194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7752): Terminating (SIGTERM) 01:17:34.143479 --- ParallelTerminationStrategy: PID 7746 died... 01:17:34.162636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7746): Terminated: ok {rc=0} 01:17:34.206992 --- ParallelTerminationStrategy: PID 7749 died... 01:17:34.225699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7749): Terminated: ok {rc=0} 01:17:34.270571 --- ParallelTerminationStrategy: PID 7752 died... 01:17:34.289311 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7752): Terminated: ok {rc=0} 01:17:34.375678 bus /sierra_3: Setting Powered False 01:17:35.474592 bus /sierra_3: Setting Powered False 01:17:36.591211 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 01:17:37.844557 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:17:37.852054 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 01:17:37.885306 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 01:17:37.912577 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 01:17:37.966709 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 01:17:38.000301 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 01:17:38.027508 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 01:17:38.577958 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 01:17:38.630418 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:17:38.641964 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:17:38.716278 tst mo_mt_call.py: using LAC 24980 01:17:38.843340 tst mo_mt_call.py: using RAC 245 01:17:38.969683 tst mo_mt_call.py: using CellId 24980 01:17:39.098712 tst mo_mt_call.py: using BVCI 24981 01:17:39.217709 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:17:39.229259 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:17:39.240543 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:17:39.251899 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:17:39.263341 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:17:39.274644 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:17:39.392675 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:17:39.515102 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:17:40.020403 run create_hlr_db(pid=7759): Launched 01:17:40.138386 bus /sierra_2: Setting Powered False 01:17:41.199154 run create_hlr_db(pid=7759): Terminated: ok {rc=0} 01:17:41.645248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7761): Launched 01:17:41.973611 run osmo-hlr_10.42.42.2(pid=7762): Launched 01:17:42.099600 run osmo-stp_10.42.42.5: Starting osmo-stp 01:17:42.662231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7764): Launched 01:17:42.988268 run osmo-stp_10.42.42.5(pid=7765): Launched 01:17:43.113583 run osmo-msc_10.42.42.6: Starting osmo-msc 01:17:43.703183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7767): Launched 01:17:44.030579 run osmo-msc_10.42.42.6(pid=7768): Launched 01:17:44.214397 run osmo-stp_10.42.42.5(pid=7765): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7765)] 01:17:44.351574 run osmo-stp_10.42.42.5(pid=7765): stdout: | (launched: 2022-12-10_01:17:42.929115) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:44.488933 run osmo-stp_10.42.42.5(pid=7765): stderr: | 20221210011743121 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011743121 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011743122 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011743122 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011743124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011743124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011743125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:44.625423 run osmo-stp_10.42.42.5(pid=7765): stdout: | (launched: 2022-12-10_01:17:42.929115) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:44.754959 run osmo-stp_10.42.42.5(pid=7765): stderr: | 20221210011743121 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011743121 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011743122 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011743122 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011743124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011743124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011743125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:44.909702 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7765): Process ended prematurely: osmo-stp_10.42.42.5(pid=7765) [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7765)] [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 01:17:44.919574 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 01:17:44.947510 run osmo-hlr_10.42.42.2(pid=7762): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7762)] 01:17:44.997696 run osmo-hlr_10.42.42.2(pid=7762): stdout: | (launched: 2022-12-10_01:17:41.914256) 01:17:45.049568 run osmo-hlr_10.42.42.2(pid=7762): stderr: | 20221210011742115 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011742115 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011742115 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011742115 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011742115 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011742116 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011742126 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011742135 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011742135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011742135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:17:45.121884 run osmo-msc_10.42.42.6(pid=7768): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7768)] 01:17:45.172556 run osmo-msc_10.42.42.6(pid=7768): stdout: | (launched: 2022-12-10_01:17:43.971323) 01:17:45.224473 run osmo-msc_10.42.42.6(pid=7768): stderr: | 20221210011744295 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210011744295 DLGLOBAL DEBUG validating counter group 0x7efd570f3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210011744295 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210011744295 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210011744295 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210011744295 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210011744297 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210011744298 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210011744298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210011744298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:17:45.276448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7761): Terminating (SIGTERM) 01:17:45.318311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7764): Terminating (SIGTERM) 01:17:45.360163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7767): Terminating (SIGTERM) 01:17:45.402352 --- ParallelTerminationStrategy: PID 7761 died... 01:17:45.422378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7761): Terminated: ok {rc=0} 01:17:45.468887 --- ParallelTerminationStrategy: PID 7764 died... 01:17:45.488695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7764): Terminated: ok {rc=0} 01:17:45.535156 --- ParallelTerminationStrategy: PID 7767 died... 01:17:45.554846 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7767): Terminated: ok {rc=0} 01:17:45.644011 bus /sierra_3: Setting Powered False 01:17:46.744652 bus /sierra_3: Setting Powered False 01:17:47.865876 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 01:17:49.013974 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:17:49.026068 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:17:49.096458 tst mo_mt_call_osmux.py: using LAC 24981 01:17:49.216386 tst mo_mt_call_osmux.py: using RAC 246 01:17:49.337633 tst mo_mt_call_osmux.py: using CellId 24981 01:17:49.458844 tst mo_mt_call_osmux.py: using BVCI 24982 01:17:49.571181 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:17:49.582453 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:17:49.593438 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:17:49.605151 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:17:49.616915 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:17:49.628479 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:17:49.750273 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:17:49.868652 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:17:50.376723 run create_hlr_db(pid=7770): Launched 01:17:50.510315 bus /sierra_2: Setting Powered False 01:17:51.570195 run create_hlr_db(pid=7770): Terminated: ok {rc=0} 01:17:52.006401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7772): Launched 01:17:52.312455 run osmo-hlr_10.42.42.2(pid=7773): Launched 01:17:52.430061 run osmo-stp_10.42.42.5: Starting osmo-stp 01:17:52.971767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7775): Launched 01:17:53.277395 run osmo-stp_10.42.42.5(pid=7776): Launched 01:17:53.395337 run osmo-msc_10.42.42.6: Starting osmo-msc 01:17:53.949495 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7778): Launched 01:17:54.256701 run osmo-msc_10.42.42.6(pid=7779): Launched 01:17:54.428702 run osmo-stp_10.42.42.5(pid=7776): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7776)] 01:17:54.558147 run osmo-stp_10.42.42.5(pid=7776): stdout: | (launched: 2022-12-10_01:17:53.221602) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:54.687173 run osmo-stp_10.42.42.5(pid=7776): stderr: | 20221210011753394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011753394 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011753394 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011753395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011753395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011753395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011753395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:54.814465 run osmo-stp_10.42.42.5(pid=7776): stdout: | (launched: 2022-12-10_01:17:53.221602) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:54.936083 run osmo-stp_10.42.42.5(pid=7776): stderr: | 20221210011753394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011753394 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011753394 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011753395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011753395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011753395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011753395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:55.082060 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7776): Process ended prematurely: osmo-stp_10.42.42.5(pid=7776) [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7776)] [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 01:17:55.091165 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 01:17:55.118639 run osmo-hlr_10.42.42.2(pid=7773): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7773)] 01:17:55.166428 run osmo-hlr_10.42.42.2(pid=7773): stdout: | (launched: 2022-12-10_01:17:52.256401) 01:17:55.216013 run osmo-hlr_10.42.42.2(pid=7773): stderr: | 20221210011752432 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011752432 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011752432 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011752432 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011752432 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011752432 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011752444 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011752452 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011752453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011752453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:17:55.285140 run osmo-msc_10.42.42.6(pid=7779): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7779)] 01:17:55.332778 run osmo-msc_10.42.42.6(pid=7779): stdout: | (launched: 2022-12-10_01:17:54.200228) 01:17:55.382181 run osmo-msc_10.42.42.6(pid=7779): stderr: | 20221210011754475 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210011754475 DLGLOBAL DEBUG validating counter group 0x7fb911e1fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210011754475 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210011754475 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210011754475 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210011754475 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210011754478 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210011754478 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210011754478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210011754478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:17:55.432050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7772): Terminating (SIGTERM) 01:17:55.471871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7775): Terminating (SIGTERM) 01:17:55.511803 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7778): Terminating (SIGTERM) 01:17:55.552130 --- ParallelTerminationStrategy: PID 7772 died... 01:17:55.571465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7772): Terminated: ok {rc=0} 01:17:55.616064 --- ParallelTerminationStrategy: PID 7775 died... 01:17:55.634707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7775): Terminated: ok {rc=0} 01:17:55.679046 --- ParallelTerminationStrategy: PID 7778 died... 01:17:55.697804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7778): Terminated: ok {rc=0} 01:17:55.781522 bus /sierra_3: Setting Powered False 01:17:56.880471 bus /sierra_3: Setting Powered False 01:17:57.999626 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:17:59.264379 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:17:59.271493 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:17:59.304537 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 01:17:59.331661 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:17:59.382651 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:17:59.415408 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 01:17:59.442281 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:17:59.997749 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 01:18:00.049658 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:00.061293 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:18:00.130702 tst mo_mt_call.py: using LAC 24982 01:18:00.257735 tst mo_mt_call.py: using RAC 247 01:18:00.383153 tst mo_mt_call.py: using CellId 24982 01:18:00.510433 tst mo_mt_call.py: using BVCI 24983 01:18:00.628785 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:00.640368 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:00.651905 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:00.663346 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:00.674945 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:00.686355 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:18:00.800868 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:18:00.932765 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:18:01.425643 run create_hlr_db(pid=7784): Launched 01:18:01.602788 bus /sierra_2: Setting Powered False 01:18:02.662703 run create_hlr_db(pid=7784): Terminated: ok {rc=0} 01:18:03.168335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7786): Launched 01:18:03.494277 run osmo-hlr_10.42.42.2(pid=7787): Launched 01:18:03.620424 run osmo-stp_10.42.42.5: Starting osmo-stp 01:18:04.180901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7789): Launched 01:18:04.505972 run osmo-stp_10.42.42.5(pid=7790): Launched 01:18:04.631497 run osmo-msc_10.42.42.6: Starting osmo-msc 01:18:05.220691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7792): Launched 01:18:05.546695 run osmo-msc_10.42.42.6(pid=7793): Launched 01:18:05.730678 run osmo-stp_10.42.42.5(pid=7790): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7790)] 01:18:05.867603 run osmo-stp_10.42.42.5(pid=7790): stdout: | (launched: 2022-12-10_01:18:04.446766) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:18:06.005962 run osmo-stp_10.42.42.5(pid=7790): stderr: | 20221210011804642 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011804642 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011804642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011804643 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011804643 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011804643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011804643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:18:06.141937 run osmo-stp_10.42.42.5(pid=7790): stdout: | (launched: 2022-12-10_01:18:04.446766) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:18:06.271221 run osmo-stp_10.42.42.5(pid=7790): stderr: | 20221210011804642 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011804642 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011804642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011804643 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011804643 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011804643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011804643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:18:06.426130 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7790): Process ended prematurely: osmo-stp_10.42.42.5(pid=7790) [trial-2367↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7790)] [trial-2367↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 01:18:06.435611 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 01:18:06.463438 run osmo-hlr_10.42.42.2(pid=7787): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7787)] 01:18:06.513357 run osmo-hlr_10.42.42.2(pid=7787): stdout: | (launched: 2022-12-10_01:18:03.434943) 01:18:06.564865 run osmo-hlr_10.42.42.2(pid=7787): stderr: | 20221210011803636 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011803636 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011803636 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011803636 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011803636 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011803636 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011803648 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011803656 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011803656 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011803656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:18:06.637254 run osmo-msc_10.42.42.6(pid=7793): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7793)] 01:18:06.686707 run osmo-msc_10.42.42.6(pid=7793): stdout: | (launched: 2022-12-10_01:18:05.487201) 01:18:06.737967 run osmo-msc_10.42.42.6(pid=7793): stderr: | 20221210011805810 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210011805810 DLGLOBAL DEBUG validating counter group 0x7fdb1b149c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210011805810 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210011805811 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210011805811 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210011805811 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210011805813 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210011805813 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210011805813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210011805813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:18:06.789718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7786): Terminating (SIGTERM) 01:18:06.831226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7789): Terminating (SIGTERM) 01:18:06.872618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7792): Terminating (SIGTERM) 01:18:06.914433 --- ParallelTerminationStrategy: PID 7786 died... 01:18:06.934035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7786): Terminated: ok {rc=0} 01:18:06.979928 --- ParallelTerminationStrategy: PID 7789 died... 01:18:06.999444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7789): Terminated: ok {rc=0} 01:18:07.045199 --- ParallelTerminationStrategy: PID 7792 died... 01:18:07.064705 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7792): Terminated: ok {rc=0} 01:18:07.152454 bus /sierra_3: Setting Powered False 01:18:08.250832 bus /sierra_3: Setting Powered False 01:18:09.368494 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 01:18:10.515918 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:10.528310 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:18:10.597396 tst mo_mt_call_osmux.py: using LAC 24983 01:18:10.741683 tst mo_mt_call_osmux.py: using RAC 248 01:18:10.873298 tst mo_mt_call_osmux.py: using CellId 24983 01:18:11.001386 tst mo_mt_call_osmux.py: using BVCI 24984 01:18:11.119865 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:11.131836 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:11.143348 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:11.154964 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:11.166624 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:11.178227 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:18:11.294026 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:18:11.408665 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:18:11.882183 run create_hlr_db(pid=7795): Launched 01:18:12.018470 bus /sierra_2: Setting Powered False 01:18:13.082834 run create_hlr_db(pid=7795): Terminated: ok {rc=0} 01:18:13.535267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7797): Launched 01:18:13.864503 run osmo-hlr_10.42.42.2(pid=7798): Launched 01:18:13.989138 run osmo-stp_10.42.42.5: Starting osmo-stp 01:18:14.555999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7800): Launched 01:18:14.885184 run osmo-stp_10.42.42.5(pid=7801): Launched 01:18:15.010964 run osmo-msc_10.42.42.6: Starting osmo-msc 01:18:15.601761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7803): Launched 01:18:15.945695 run osmo-msc_10.42.42.6(pid=7804): Launched 01:18:16.298727 run osmo-stp_10.42.42.5(pid=7801): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7801)] 01:18:16.593643 run osmo-stp_10.42.42.5(pid=7801): stdout: | (launched: 2022-12-10_01:18:14.825562) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:18:16.861583 run osmo-stp_10.42.42.5(pid=7801): stderr: | 20221210011815020 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011815020 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011815020 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011815021 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011815021 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011815021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011815021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:18:17.026229 run osmo-stp_10.42.42.5(pid=7801): stdout: | (launched: 2022-12-10_01:18:14.825562) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:18:17.159195 run osmo-stp_10.42.42.5(pid=7801): stderr: | 20221210011815020 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011815020 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011815020 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011815021 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011815021 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011815021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011815021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:18:17.319803 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7801): Process ended prematurely: osmo-stp_10.42.42.5(pid=7801) [trial-2367↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7801)] [trial-2367↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 01:18:17.330664 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 01:18:17.360744 run osmo-hlr_10.42.42.2(pid=7798): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7798)] 01:18:17.413925 run osmo-hlr_10.42.42.2(pid=7798): stdout: | (launched: 2022-12-10_01:18:13.805282) 01:18:17.467376 run osmo-hlr_10.42.42.2(pid=7798): stderr: | 20221210011814007 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011814007 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011814007 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011814007 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011814007 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011814007 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011814021 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011814029 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011814029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011814029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:18:17.540404 run osmo-msc_10.42.42.6(pid=7804): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7804)] 01:18:17.590720 run osmo-msc_10.42.42.6(pid=7804): stdout: | (launched: 2022-12-10_01:18:15.879138) 01:18:17.642701 run osmo-msc_10.42.42.6(pid=7804): stderr: | 20221210011816574 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210011816577 DLGLOBAL DEBUG validating counter group 0x7f15fa1f7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210011816577 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210011816577 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210011816578 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210011816578 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210011816580 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210011816580 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210011816580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210011816580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:18:17.694620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7797): Terminating (SIGTERM) 01:18:17.736418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7800): Terminating (SIGTERM) 01:18:17.778473 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7803): Terminating (SIGTERM) 01:18:17.820314 --- ParallelTerminationStrategy: PID 7797 died... 01:18:17.840077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7797): Terminated: ok {rc=0} 01:18:17.886213 --- ParallelTerminationStrategy: PID 7800 died... 01:18:17.905754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7800): Terminated: ok {rc=0} 01:18:17.951728 --- ParallelTerminationStrategy: PID 7803 died... 01:18:17.971321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7803): Terminated: ok {rc=0} 01:18:18.058385 bus /sierra_3: Setting Powered False 01:18:19.159354 bus /sierra_3: Setting Powered False 01:18:20.276148 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 01:18:21.531535 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:18:21.537810 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 01:18:21.571328 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 01:18:21.599060 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 01:18:21.653408 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 01:18:21.687448 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 01:18:21.714495 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 01:18:22.263362 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 01:18:22.315059 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:18:22.326448 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:18:22.397551 tst mo_mt_call.py: using LAC 24984 01:18:22.524836 tst mo_mt_call.py: using RAC 249 01:18:22.652510 tst mo_mt_call.py: using CellId 24984 01:18:22.779749 tst mo_mt_call.py: using BVCI 24985 01:18:22.897384 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:18:22.908692 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:18:22.919930 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:18:22.931149 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:18:22.942482 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:18:22.953785 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:18:23.068181 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:18:23.185666 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:18:23.690686 run create_hlr_db(pid=7809): Launched 01:18:23.823504 bus /sierra_2: Setting Powered False 01:18:24.883632 run create_hlr_db(pid=7809): Terminated: ok {rc=0} 01:18:25.308494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7811): Launched 01:18:25.615288 run osmo-hlr_10.42.42.2(pid=7812): Launched 01:18:25.733714 run osmo-stp_10.42.42.5: Starting osmo-stp 01:18:26.263112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7814): Launched 01:18:26.569515 run osmo-stp_10.42.42.5(pid=7815): Launched 01:18:26.687988 run osmo-msc_10.42.42.6: Starting osmo-msc 01:18:27.243100 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7817): Launched 01:18:27.549992 run osmo-msc_10.42.42.6(pid=7818): Launched 01:18:27.724252 run osmo-stp_10.42.42.5(pid=7815): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7815)] 01:18:27.854175 run osmo-stp_10.42.42.5(pid=7815): stdout: | (launched: 2022-12-10_01:18:26.512609) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:18:27.983157 run osmo-stp_10.42.42.5(pid=7815): stderr: | 20221210011826683 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011826683 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011826683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011826683 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011826686 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011826686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011826686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:18:28.110314 run osmo-stp_10.42.42.5(pid=7815): stdout: | (launched: 2022-12-10_01:18:26.512609) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:18:28.232539 run osmo-stp_10.42.42.5(pid=7815): stderr: | 20221210011826683 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011826683 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011826683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011826683 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011826686 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011826686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011826686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:18:28.378718 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7815): Process ended prematurely: osmo-stp_10.42.42.5(pid=7815) [trial-2367↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7815)] [trial-2367↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 01:18:28.387639 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:18:28.414650 run osmo-hlr_10.42.42.2(pid=7812): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7812)] 01:18:28.463900 run osmo-hlr_10.42.42.2(pid=7812): stdout: | (launched: 2022-12-10_01:18:25.559091) 01:18:28.514050 run osmo-hlr_10.42.42.2(pid=7812): stderr: | 20221210011825735 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011825735 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011825735 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011825735 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011825735 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011825735 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011825747 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011825756 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011825756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011825756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:18:28.584162 run osmo-msc_10.42.42.6(pid=7818): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7818)] 01:18:28.632652 run osmo-msc_10.42.42.6(pid=7818): stdout: | (launched: 2022-12-10_01:18:27.493594) 01:18:28.682604 run osmo-msc_10.42.42.6(pid=7818): stderr: | 20221210011827767 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210011827767 DLGLOBAL DEBUG validating counter group 0x7f162eee6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210011827768 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210011827768 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210011827768 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210011827768 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210011827770 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210011827770 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210011827770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210011827771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:18:28.732789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7811): Terminating (SIGTERM) 01:18:28.773226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7814): Terminating (SIGTERM) 01:18:28.813580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7817): Terminating (SIGTERM) 01:18:28.854124 --- ParallelTerminationStrategy: PID 7811 died... 01:18:28.873405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7811): Terminated: ok {rc=0} 01:18:28.918232 --- ParallelTerminationStrategy: PID 7814 died... 01:18:28.937038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7814): Terminated: ok {rc=0} 01:18:28.981634 --- ParallelTerminationStrategy: PID 7817 died... 01:18:29.000472 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7817): Terminated: ok {rc=0} 01:18:29.087741 bus /sierra_3: Setting Powered False 01:18:30.187189 bus /sierra_3: Setting Powered False 01:18:31.320663 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 01:18:32.478192 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:18:32.489951 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:18:32.562463 tst mo_mt_call_osmux.py: using LAC 24985 01:18:32.682458 tst mo_mt_call_osmux.py: using RAC 250 01:18:32.805234 tst mo_mt_call_osmux.py: using CellId 24985 01:18:32.925405 tst mo_mt_call_osmux.py: using BVCI 24986 01:18:33.035772 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:18:33.046864 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:18:33.057760 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:18:33.068637 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:18:33.079672 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:18:33.090730 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:18:33.209908 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:18:33.327900 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:18:33.802829 run create_hlr_db(pid=7820): Launched 01:18:33.921913 bus /sierra_2: Setting Powered False 01:18:34.983151 run create_hlr_db(pid=7820): Terminated: ok {rc=0} 01:18:35.431832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7822): Launched 01:18:35.729127 run osmo-hlr_10.42.42.2(pid=7823): Launched 01:18:35.843890 run osmo-stp_10.42.42.5: Starting osmo-stp 01:18:36.355073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7825): Launched 01:18:36.652939 run osmo-stp_10.42.42.5(pid=7826): Launched 01:18:36.767903 run osmo-msc_10.42.42.6: Starting osmo-msc 01:18:37.311751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7828): Launched 01:18:37.611439 run osmo-msc_10.42.42.6(pid=7829): Launched 01:18:37.794229 run osmo-stp_10.42.42.5(pid=7826): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7826)] 01:18:37.933484 run osmo-stp_10.42.42.5(pid=7826): stdout: | (launched: 2022-12-10_01:18:36.598054) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:18:38.069788 run osmo-stp_10.42.42.5(pid=7826): stderr: | 20221210011836765 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011836766 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011836766 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011836766 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011836767 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011836767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011836767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:18:38.196688 run osmo-stp_10.42.42.5(pid=7826): stdout: | (launched: 2022-12-10_01:18:36.598054) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:18:38.315633 run osmo-stp_10.42.42.5(pid=7826): stderr: | 20221210011836765 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011836766 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011836766 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011836766 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011836767 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011836767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011836767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:18:38.457954 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7826): Process ended prematurely: osmo-stp_10.42.42.5(pid=7826) [trial-2367↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7826)] [trial-2367↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 01:18:38.466793 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 01:18:38.493727 run osmo-hlr_10.42.42.2(pid=7823): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7823)] 01:18:38.541585 run osmo-hlr_10.42.42.2(pid=7823): stdout: | (launched: 2022-12-10_01:18:35.674735) 01:18:38.590885 run osmo-hlr_10.42.42.2(pid=7823): stderr: | 20221210011835846 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011835846 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011835846 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011835846 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011835846 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011835846 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011835859 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011835869 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011835870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011835870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:18:38.659157 run osmo-msc_10.42.42.6(pid=7829): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7829)] 01:18:38.706648 run osmo-msc_10.42.42.6(pid=7829): stdout: | (launched: 2022-12-10_01:18:37.556873) 01:18:38.755737 run osmo-msc_10.42.42.6(pid=7829): stderr: | 20221210011837874 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210011837874 DLGLOBAL DEBUG validating counter group 0x7f67fe9a2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210011837874 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210011837874 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210011837874 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210011837875 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210011837876 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210011837877 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210011837877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210011837877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:18:38.805436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7822): Terminating (SIGTERM) 01:18:38.845357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7825): Terminating (SIGTERM) 01:18:38.885188 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7828): Terminating (SIGTERM) 01:18:38.925349 --- ParallelTerminationStrategy: PID 7822 died... 01:18:38.944314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7822): Terminated: ok {rc=0} 01:18:38.988775 --- ParallelTerminationStrategy: PID 7825 died... 01:18:39.007428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7825): Terminated: ok {rc=0} 01:18:39.051686 --- ParallelTerminationStrategy: PID 7828 died... 01:18:39.070382 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7828): Terminated: ok {rc=0} 01:18:39.156589 bus /sierra_3: Setting Powered False 01:18:40.257487 bus /sierra_3: Setting Powered False 01:18:41.375318 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 01:18:42.619018 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:18:42.625093 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 01:18:42.658043 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 01:18:42.684158 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 01:18:42.735344 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 01:18:42.767432 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 01:18:42.793349 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 01:18:43.345200 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 01:18:43.393527 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:18:43.404866 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:18:43.456154 tst mo_mt_call.py: using LAC 24986 01:18:43.574303 tst mo_mt_call.py: using RAC 251 01:18:43.693893 tst mo_mt_call.py: using CellId 24986 01:18:43.810277 tst mo_mt_call.py: using BVCI 24987 01:18:43.917154 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:18:43.928140 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:18:43.939166 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:18:43.950440 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:18:43.961859 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:18:43.972817 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:18:44.091513 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:18:44.206270 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:18:44.667093 run create_hlr_db(pid=7834): Launched 01:18:44.781135 bus /sierra_2: Setting Powered False 01:18:45.858781 run create_hlr_db(pid=7834): Terminated: ok {rc=0} 01:18:46.345711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7836): Launched 01:18:46.691053 run osmo-hlr_10.42.42.2(pid=7837): Launched 01:18:46.895269 run osmo-stp_10.42.42.5: Starting osmo-stp 01:18:47.539307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7839): Launched 01:18:47.838300 run osmo-stp_10.42.42.5(pid=7840): Launched 01:18:47.951955 run osmo-msc_10.42.42.6: Starting osmo-msc 01:18:48.504481 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7842): Launched 01:18:48.802692 run osmo-msc_10.42.42.6(pid=7843): Launched 01:18:48.969982 run osmo-stp_10.42.42.5(pid=7840): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7840)] 01:18:49.105068 run osmo-stp_10.42.42.5(pid=7840): stdout: | (launched: 2022-12-10_01:18:47.783066) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:18:49.240575 run osmo-stp_10.42.42.5(pid=7840): stderr: | 20221210011847951 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011847952 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011847952 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011847952 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011847953 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011847953 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011847953 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:18:49.373467 run osmo-stp_10.42.42.5(pid=7840): stdout: | (launched: 2022-12-10_01:18:47.783066) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:18:49.500413 run osmo-stp_10.42.42.5(pid=7840): stderr: | 20221210011847951 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011847952 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011847952 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011847952 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011847953 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011847953 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011847953 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:18:49.652686 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7840): Process ended prematurely: osmo-stp_10.42.42.5(pid=7840) [trial-2367↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7840)] [trial-2367↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 01:18:49.662410 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 01:18:49.690671 run osmo-hlr_10.42.42.2(pid=7837): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7837)] 01:18:49.740442 run osmo-hlr_10.42.42.2(pid=7837): stdout: | (launched: 2022-12-10_01:18:46.625062) 01:18:49.791943 run osmo-hlr_10.42.42.2(pid=7837): stderr: | 20221210011847039 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011847040 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011847040 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011847040 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011847040 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011847040 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011847052 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011847068 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011847068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011847068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:18:49.863748 run osmo-msc_10.42.42.6(pid=7843): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7843)] 01:18:49.913527 run osmo-msc_10.42.42.6(pid=7843): stdout: | (launched: 2022-12-10_01:18:48.747815) 01:18:49.964878 run osmo-msc_10.42.42.6(pid=7843): stderr: | 20221210011849017 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210011849017 DLGLOBAL DEBUG validating counter group 0x7f28475f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210011849017 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210011849017 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210011849018 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210011849018 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210011849020 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210011849020 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210011849021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210011849021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:18:50.016827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7836): Terminating (SIGTERM) 01:18:50.058157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7839): Terminating (SIGTERM) 01:18:50.100262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7842): Terminating (SIGTERM) 01:18:50.142655 --- ParallelTerminationStrategy: PID 7836 died... 01:18:50.162340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7836): Terminated: ok {rc=0} 01:18:50.208602 --- ParallelTerminationStrategy: PID 7839 died... 01:18:50.228132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7839): Terminated: ok {rc=0} 01:18:50.273732 --- ParallelTerminationStrategy: PID 7842 died... 01:18:50.293261 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7842): Terminated: ok {rc=0} 01:18:50.380755 bus /sierra_3: Setting Powered False 01:18:51.479520 bus /sierra_3: Setting Powered False 01:18:52.594208 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 01:18:53.741793 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:18:53.754191 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:18:53.808244 tst mo_mt_call_osmux.py: using LAC 24987 01:18:53.934992 tst mo_mt_call_osmux.py: using RAC 252 01:18:54.061751 tst mo_mt_call_osmux.py: using CellId 24987 01:18:54.186547 tst mo_mt_call_osmux.py: using BVCI 24988 01:18:54.302449 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:18:54.314220 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:18:54.325651 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:18:54.337282 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:18:54.349268 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:18:54.360866 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:18:54.477542 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:18:54.593292 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:18:55.055523 run create_hlr_db(pid=7845): Launched 01:18:55.170391 bus /sierra_2: Setting Powered False 01:18:56.229553 run create_hlr_db(pid=7845): Terminated: ok {rc=0} 01:18:56.645600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7847): Launched 01:18:56.945319 run osmo-hlr_10.42.42.2(pid=7848): Launched 01:18:57.060597 run osmo-stp_10.42.42.5: Starting osmo-stp 01:18:57.585977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7850): Launched 01:18:57.885441 run osmo-stp_10.42.42.5(pid=7851): Launched 01:18:58.000429 run osmo-msc_10.42.42.6: Starting osmo-msc 01:18:58.542963 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7853): Launched 01:18:58.842646 run osmo-msc_10.42.42.6(pid=7854): Launched 01:18:59.010688 run osmo-stp_10.42.42.5(pid=7851): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7851)] 01:18:59.137246 run osmo-stp_10.42.42.5(pid=7851): stdout: | (launched: 2022-12-10_01:18:57.830517) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:18:59.263813 run osmo-stp_10.42.42.5(pid=7851): stderr: | 20221210011857999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011858000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011858000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011858000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011858001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011858001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011858001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:18:59.388273 run osmo-stp_10.42.42.5(pid=7851): stdout: | (launched: 2022-12-10_01:18:57.830517) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:18:59.507128 run osmo-stp_10.42.42.5(pid=7851): stderr: | 20221210011857999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011858000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011858000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011858000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011858001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011858001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011858001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:18:59.650002 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7851): Process ended prematurely: osmo-stp_10.42.42.5(pid=7851) [trial-2367↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7851)] [trial-2367↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 01:18:59.658932 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 01:18:59.685575 run osmo-hlr_10.42.42.2(pid=7848): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7848)] 01:18:59.732749 run osmo-hlr_10.42.42.2(pid=7848): stdout: | (launched: 2022-12-10_01:18:56.890647) 01:18:59.781898 run osmo-hlr_10.42.42.2(pid=7848): stderr: | 20221210011857065 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011857065 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011857065 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011857065 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011857065 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011857065 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011857077 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011857085 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011857086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011857086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:18:59.850049 run osmo-msc_10.42.42.6(pid=7854): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7854)] 01:18:59.897106 run osmo-msc_10.42.42.6(pid=7854): stdout: | (launched: 2022-12-10_01:18:58.787929) 01:18:59.945743 run osmo-msc_10.42.42.6(pid=7854): stderr: | 20221210011859058 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210011859058 DLGLOBAL DEBUG validating counter group 0x7f72c2048c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210011859058 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210011859058 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210011859059 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210011859059 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210011859061 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210011859062 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210011859062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210011859062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:18:59.994954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7847): Terminating (SIGTERM) 01:19:00.034330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7850): Terminating (SIGTERM) 01:19:00.073872 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7853): Terminating (SIGTERM) 01:19:00.113546 --- ParallelTerminationStrategy: PID 7847 died... 01:19:00.132163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7847): Terminated: ok {rc=0} 01:19:00.175885 --- ParallelTerminationStrategy: PID 7850 died... 01:19:00.194381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7850): Terminated: ok {rc=0} 01:19:00.238026 --- ParallelTerminationStrategy: PID 7853 died... 01:19:00.256355 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7853): Terminated: ok {rc=0} 01:19:00.340354 bus /sierra_3: Setting Powered False 01:19:01.448829 bus /sierra_3: Setting Powered False 01:19:02.568339 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 emergency:trx-umtrx --------------------------------------------------------------------- 01:19:03.815760 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:19:03.821580 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 01:19:03.854904 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 01:19:03.881844 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 01:19:03.967046 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 01:19:04.000329 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 01:19:04.027431 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 01:19:04.611098 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2367 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 01:19:04.616512 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:04.627672 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 01:19:04.677074 tst emergency_mo_mt_call.py: using LAC 24988 01:19:04.799478 tst emergency_mo_mt_call.py: using RAC 253 01:19:04.921970 tst emergency_mo_mt_call.py: using CellId 24988 01:19:05.045247 tst emergency_mo_mt_call.py: using BVCI 24989 01:19:05.160217 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:05.171274 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:05.182133 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:05.193203 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:05.204161 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:05.215137 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 01:19:05.328640 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 01:19:05.451820 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:19:05.941256 run create_hlr_db(pid=7859): Launched 01:19:06.071006 bus /sierra_2: Setting Powered False 01:19:07.133101 run create_hlr_db(pid=7859): Terminated: ok {rc=0} 01:19:07.553403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7861): Launched 01:19:07.848453 run osmo-hlr_10.42.42.2(pid=7862): Launched 01:19:07.961076 run osmo-stp_10.42.42.5: Starting osmo-stp 01:19:08.464852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7864): Launched 01:19:08.760728 run osmo-stp_10.42.42.5(pid=7865): Launched 01:19:08.883758 tst emergency_mo_mt_call.py: using MSISDN 7475 01:19:09.033698 run osmo-msc_10.42.42.6: Starting osmo-msc 01:19:09.561560 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7867): Launched 01:19:09.857617 run osmo-msc_10.42.42.6(pid=7868): Launched 01:19:10.025306 run osmo-stp_10.42.42.5(pid=7865): ERR: Terminated: ERROR {rc=1} [trial-2367↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7865)] 01:19:10.151472 run osmo-stp_10.42.42.5(pid=7865): stdout: | (launched: 2022-12-10_01:19:08.706704) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:19:10.276874 run osmo-stp_10.42.42.5(pid=7865): stderr: | 20221210011908875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011908875 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011908875 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011908877 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011908877 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011908878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011908878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:19:10.400127 run osmo-stp_10.42.42.5(pid=7865): stdout: | (launched: 2022-12-10_01:19:08.706704) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:19:10.518665 run osmo-stp_10.42.42.5(pid=7865): stderr: | 20221210011908875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011908875 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011908875 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011908877 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011908877 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011908878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011908878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:19:10.660200 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=7865): Process ended prematurely: osmo-stp_10.42.42.5(pid=7865) [trial-2367↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7865)] [trial-2367↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 01:19:10.668743 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 01:19:10.694926 run osmo-hlr_10.42.42.2(pid=7862): ERR: Terminated: ERROR {rc=237} [trial-2367↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7862)] 01:19:10.742338 run osmo-hlr_10.42.42.2(pid=7862): stdout: | (launched: 2022-12-10_01:19:07.794447) 01:19:10.791434 run osmo-hlr_10.42.42.2(pid=7862): stderr: | 20221210011907969 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011907969 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011907969 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011907969 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011907969 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011907969 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011907981 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011907992 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011907992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011907993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:19:10.859719 run osmo-msc_10.42.42.6(pid=7868): ERR: Terminated: ERROR {rc=2} [trial-2367↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7868)] 01:19:10.907418 run osmo-msc_10.42.42.6(pid=7868): stdout: | (launched: 2022-12-10_01:19:09.803394) 01:19:10.956869 run osmo-msc_10.42.42.6(pid=7868): stderr: | 20221210011910072 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210011910072 DLGLOBAL DEBUG validating counter group 0x7fa9c82bcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210011910072 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210011910072 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210011910072 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210011910073 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210011910074 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210011910075 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210011910075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210011910076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:19:11.006410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7861): Terminating (SIGTERM) 01:19:11.045947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7864): Terminating (SIGTERM) 01:19:11.085660 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7867): Terminating (SIGTERM) 01:19:11.125704 --- ParallelTerminationStrategy: PID 7861 died... 01:19:11.144615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7861): Terminated: ok {rc=0} 01:19:11.188805 --- ParallelTerminationStrategy: PID 7864 died... 01:19:11.207356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7864): Terminated: ok {rc=0} 01:19:11.251468 --- ParallelTerminationStrategy: PID 7867 died... 01:19:11.270105 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7867): Terminated: ok {rc=0} 01:19:11.353636 bus /sierra_3: Setting Powered False 01:19:12.452055 bus /sierra_3: Setting Powered False 01:19:13.567841 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 01:19:14.652758 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:14.664015 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 01:19:14.714366 tst emergency_preemptive_call.py: using LAC 24989 01:19:14.829395 tst emergency_preemptive_call.py: using RAC 254 01:19:14.946126 tst emergency_preemptive_call.py: using CellId 24989 01:19:15.059874 tst emergency_preemptive_call.py: using BVCI 24990 01:19:15.165512 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:15.175981 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:15.186273 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:15.196844 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:15.207505 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:15.218026 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 01:19:15.334762 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 01:19:15.455420 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 01:19:15.569781 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 01:19:15.686159 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:19:16.265499 run create_hlr_db(pid=7870): Launched 01:19:16.414272 bus /sierra_2: Setting Powered False 01:19:17.472865 run create_hlr_db(pid=7870): Terminated: ok {rc=0} 01:19:17.941824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7872): Launched 01:19:18.256428 run osmo-hlr_10.42.42.2(pid=7873): Launched 01:19:18.377031 run osmo-stp_10.42.42.5: Starting osmo-stp 01:19:18.919907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7875): Launched 01:19:19.233915 run osmo-stp_10.42.42.5(pid=7876): Launched 01:19:19.363887 tst emergency_preemptive_call.py: using MSISDN 7476 01:19:19.524043 run osmo-msc_10.42.42.6: Starting osmo-msc 01:19:20.088073 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7878): Launched 01:19:20.402202 run osmo-msc_10.42.42.6(pid=7879): Launched 01:19:20.578570 run osmo-stp_10.42.42.5(pid=7876): ERR: Terminated: ERROR {rc=1} [trial-2367↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7876)] 01:19:20.712269 run osmo-stp_10.42.42.5(pid=7876): stdout: | (launched: 2022-12-10_01:19:19.176633) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:19:20.845328 run osmo-stp_10.42.42.5(pid=7876): stderr: | 20221210011919370 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011919370 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011919371 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011919371 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011919372 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011919372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011919372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:19:20.977187 run osmo-stp_10.42.42.5(pid=7876): stdout: | (launched: 2022-12-10_01:19:19.176633) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:19:21.102138 run osmo-stp_10.42.42.5(pid=7876): stderr: | 20221210011919370 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011919370 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011919371 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011919371 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011919372 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011919372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011919372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:19:21.251203 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=7876): Process ended prematurely: osmo-stp_10.42.42.5(pid=7876) [trial-2367↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7876)] [trial-2367↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 01:19:21.260177 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 01:19:21.287861 run osmo-hlr_10.42.42.2(pid=7873): ERR: Terminated: ERROR {rc=237} [trial-2367↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7873)] 01:19:21.337876 run osmo-hlr_10.42.42.2(pid=7873): stdout: | (launched: 2022-12-10_01:19:18.199326) 01:19:21.389441 run osmo-hlr_10.42.42.2(pid=7873): stderr: | 20221210011918395 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011918395 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011918395 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011918395 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011918395 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011918395 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011918409 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011918420 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011918421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011918421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:19:21.461544 run osmo-msc_10.42.42.6(pid=7879): ERR: Terminated: ERROR {rc=2} [trial-2367↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7879)] 01:19:21.511393 run osmo-msc_10.42.42.6(pid=7879): stdout: | (launched: 2022-12-10_01:19:20.344859) 01:19:21.562645 run osmo-msc_10.42.42.6(pid=7879): stderr: | 20221210011920667 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210011920667 DLGLOBAL DEBUG validating counter group 0x7f7f77b92c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210011920667 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210011920667 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210011920667 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210011920667 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210011920669 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210011920670 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210011920670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210011920670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:19:21.614633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7872): Terminating (SIGTERM) 01:19:21.656318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7875): Terminating (SIGTERM) 01:19:21.698229 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7878): Terminating (SIGTERM) 01:19:21.740134 --- ParallelTerminationStrategy: PID 7872 died... 01:19:21.760100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7872): Terminated: ok {rc=0} 01:19:21.806332 --- ParallelTerminationStrategy: PID 7875 died... 01:19:21.826002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7875): Terminated: ok {rc=0} 01:19:21.871726 --- ParallelTerminationStrategy: PID 7878 died... 01:19:21.891409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7878): Terminated: ok {rc=0} 01:19:21.978991 bus /sierra_9: Setting Powered False 01:19:23.078558 bus /sierra_9: Setting Powered False 01:19:24.193814 bus /sierra_8: Setting Powered False 01:19:25.291119 bus /sierra_8: Setting Powered False 01:19:26.408499 bus /sierra_3: Setting Powered False 01:19:27.506740 bus /sierra_3: Setting Powered False 01:19:28.623726 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:trx-umtrx --------------------------------------------------------------------- 01:19:29.895397 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:19:29.899703 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 01:19:29.932142 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 01:19:29.969928 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 01:19:30.054048 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 01:19:30.086156 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 01:19:30.123970 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 01:19:30.711838 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 01:19:30.760916 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:30.771492 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 01:19:30.819659 tst cs_paging_gprs_active.py: using LAC 24990 01:19:30.975261 tst cs_paging_gprs_active.py: using RAC 255 01:19:31.110214 tst cs_paging_gprs_active.py: using CellId 24990 01:19:31.229239 tst cs_paging_gprs_active.py: using BVCI 24991 01:19:31.357648 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:31.368485 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:31.379588 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:31.391462 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:31.403229 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:31.414932 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:31.426855 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:31.438621 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:31.450512 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 01:19:31.589387 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 01:19:31.717075 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:19:31.939974 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:19:32.269211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7884): Launched 01:19:32.549369 run iperf3-srv_10.42.42.10(pid=7885): Launched 01:19:32.671492 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:19:32.887669 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:19:33.210122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7886): Launched 01:19:33.489742 run iperf3-srv_10.42.42.10(pid=7887): Launched 01:19:33.610653 tst cs_paging_gprs_active.py:38: start network... 01:19:33.826578 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:19:34.324517 run create_hlr_db(pid=7888): Launched 01:19:34.455272 bus /sierra_2: Setting Powered False 01:19:35.518231 run create_hlr_db(pid=7888): Terminated: ok {rc=0} 01:19:35.946471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7890): Launched 01:19:36.245659 run osmo-hlr_10.42.42.2(pid=7891): Launched 01:19:36.360452 run osmo-stp_10.42.42.5: Starting osmo-stp 01:19:36.889772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7893): Launched 01:19:37.188504 run osmo-stp_10.42.42.5(pid=7894): Launched 01:19:37.303349 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:19:37.819457 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7896): Launched 01:19:37.933535 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:19:38.185227 run patchelf(pid=7897): Launched 01:19:38.351686 run osmo-stp_10.42.42.5(pid=7894): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7894)] 01:19:38.477965 run osmo-stp_10.42.42.5(pid=7894): stdout: | (launched: 2022-12-10_01:19:37.133809) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:19:38.605374 run osmo-stp_10.42.42.5(pid=7894): stderr: | 20221210011937301 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011937301 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011937301 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011937302 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011937302 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011937302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011937302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:19:38.733508 run osmo-stp_10.42.42.5(pid=7894): stdout: | (launched: 2022-12-10_01:19:37.133809) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:19:38.855552 run osmo-stp_10.42.42.5(pid=7894): stderr: | 20221210011937301 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011937301 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011937301 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011937302 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011937302 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011937302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011937302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:19:39.000017 run patchelf(pid=7897): Terminating (SIGINT) 01:19:39.166983 run patchelf(pid=7897): Terminated: ok {rc=0} 01:19:39.287344 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7894): Process ended prematurely: osmo-stp_10.42.42.5(pid=7894) [trial-2367↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7894)] [trial-2367↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 01:19:39.296692 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 01:19:39.323854 run osmo-hlr_10.42.42.2(pid=7891): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7891)] 01:19:39.371190 run osmo-hlr_10.42.42.2(pid=7891): stdout: | (launched: 2022-12-10_01:19:36.191126) 01:19:39.419978 run osmo-hlr_10.42.42.2(pid=7891): stderr: | 20221210011936365 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011936365 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011936365 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011936365 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011936365 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011936365 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011936382 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011936392 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011936392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011936392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:19:39.469070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7884): Terminating (SIGTERM) 01:19:39.508423 run iperf3-srv_10.42.42.10(pid=7885): Terminating (SIGTERM) 01:19:39.547744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7886): Terminating (SIGTERM) 01:19:39.586841 run iperf3-srv_10.42.42.10(pid=7887): Terminating (SIGTERM) 01:19:39.625988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7890): Terminating (SIGTERM) 01:19:39.665366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7893): Terminating (SIGTERM) 01:19:39.704589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7896): Terminating (SIGTERM) 01:19:39.744091 --- ParallelTerminationStrategy: PID 7884 died... 01:19:39.763012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7884): Terminated: ok {rc=0} 01:19:39.806796 --- ParallelTerminationStrategy: PID 7885 died... 01:19:39.825147 run iperf3-srv_10.42.42.10(pid=7885): Terminated {rc=256} 01:19:39.868291 --- ParallelTerminationStrategy: PID 7886 died... 01:19:39.886758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7886): Terminated: ok {rc=0} 01:19:39.930355 --- ParallelTerminationStrategy: PID 7887 died... 01:19:39.948725 run iperf3-srv_10.42.42.10(pid=7887): Terminated {rc=256} 01:19:39.992102 --- ParallelTerminationStrategy: PID 7890 died... 01:19:40.010501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7890): Terminated: ok {rc=0} 01:19:40.053969 --- ParallelTerminationStrategy: PID 7893 died... 01:19:40.072443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7893): Terminated: ok {rc=0} 01:19:40.115857 --- ParallelTerminationStrategy: PID 7896 died... 01:19:40.134409 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7896): Terminated: ok {rc=0} 01:19:40.219130 bus /gobi_0: Setting Powered False 01:19:41.318759 bus /gobi_0: Setting Powered False 01:19:42.434074 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-umtrx iperf3.py ---------------------------------------------- 01:19:43.578264 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:43.589648 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 01:19:43.639563 tst iperf3.py: using LAC 24991 01:19:43.756046 tst iperf3.py: using RAC 1 01:19:43.873582 tst iperf3.py: using CellId 24991 01:19:43.998928 tst iperf3.py: using BVCI 24992 01:19:44.115283 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:44.126519 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:44.137490 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:44.148680 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:44.159760 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:44.170776 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:44.181817 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:44.192608 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:44.203687 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 01:19:44.315615 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:19:44.516417 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:19:44.815067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7898): Launched 01:19:45.075024 run iperf3-srv_10.42.42.10(pid=7899): Launched 01:19:45.187214 tst iperf3.py:8: start network... 01:19:45.385822 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:19:45.853584 run create_hlr_db(pid=7900): Launched 01:19:46.000093 bus /gobi_6: Setting Powered False 01:19:47.094727 run create_hlr_db(pid=7900): Terminated: ok {rc=0} 01:19:47.583013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7902): Launched 01:19:47.904351 run osmo-hlr_10.42.42.2(pid=7903): Launched 01:19:48.026907 run osmo-stp_10.42.42.5: Starting osmo-stp 01:19:48.577094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7905): Launched 01:19:48.897531 run osmo-stp_10.42.42.5(pid=7906): Launched 01:19:49.020049 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:19:49.571697 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7908): Launched 01:19:49.694960 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:19:49.963831 run patchelf(pid=7909): Launched 01:19:50.142130 run osmo-stp_10.42.42.5(pid=7906): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7906)] 01:19:50.277272 run osmo-stp_10.42.42.5(pid=7906): stdout: | (launched: 2022-12-10_01:19:48.839491) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:19:50.413753 run osmo-stp_10.42.42.5(pid=7906): stderr: | 20221210011949029 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011949029 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011949030 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011949030 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011949031 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011949031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011949031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:19:50.550438 run osmo-stp_10.42.42.5(pid=7906): stdout: | (launched: 2022-12-10_01:19:48.839491) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:19:50.682112 run osmo-stp_10.42.42.5(pid=7906): stderr: | 20221210011949029 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210011949029 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210011949030 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210011949030 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210011949031 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210011949031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210011949031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:19:50.837867 run patchelf(pid=7909): Terminating (SIGINT) 01:19:51.015777 run patchelf(pid=7909): Terminated: ok {rc=0} 01:19:51.143959 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7906): Process ended prematurely: osmo-stp_10.42.42.5(pid=7906) [trial-2367↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7906)] [trial-2367↪gprs:trx-umtrx↪iperf3.py:8] 01:19:51.153999 tst iperf3.py:8: Test FAILED (7.6 sec) 01:19:51.182478 run osmo-hlr_10.42.42.2(pid=7903): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7903)] 01:19:51.231705 run osmo-hlr_10.42.42.2(pid=7903): stdout: | (launched: 2022-12-10_01:19:47.846063) 01:19:51.282587 run osmo-hlr_10.42.42.2(pid=7903): stderr: | 20221210011948044 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210011948044 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210011948044 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210011948044 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210011948044 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210011948044 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210011948056 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210011948064 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210011948064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210011948064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:19:51.334020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7898): Terminating (SIGTERM) 01:19:51.375230 run iperf3-srv_10.42.42.10(pid=7899): Terminating (SIGTERM) 01:19:51.416393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7902): Terminating (SIGTERM) 01:19:51.457763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7905): Terminating (SIGTERM) 01:19:51.499009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7908): Terminating (SIGTERM) 01:19:51.540618 --- ParallelTerminationStrategy: PID 7898 died... 01:19:51.560499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7898): Terminated: ok {rc=0} 01:19:51.606382 --- ParallelTerminationStrategy: PID 7899 died... 01:19:51.625735 run iperf3-srv_10.42.42.10(pid=7899): Terminated {rc=256} 01:19:51.671541 --- ParallelTerminationStrategy: PID 7902 died... 01:19:51.691128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7902): Terminated: ok {rc=0} 01:19:51.736754 --- ParallelTerminationStrategy: PID 7905 died... 01:19:51.755915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7905): Terminated: ok {rc=0} 01:19:51.801714 --- ParallelTerminationStrategy: PID 7908 died... 01:19:51.821139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7908): Terminated: ok {rc=0} 01:19:51.906931 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 01:19:53.055021 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:53.066162 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 01:19:53.111675 tst iperf3m4.py: using LAC 24992 01:19:53.228175 tst iperf3m4.py: using RAC 2 01:19:53.346187 tst iperf3m4.py: using CellId 24992 01:19:53.464691 tst iperf3m4.py: using BVCI 24993 01:19:53.573419 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:53.583880 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:53.594136 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:53.604472 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:53.615782 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:53.626248 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:53.636839 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:53.647736 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:53.658458 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 01:19:53.773405 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 01:19:53.898147 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 01:19:54.019421 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 01:19:54.138221 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:19:54.354912 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:19:54.677426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7910): Launched 01:19:54.957806 run iperf3-srv_10.42.42.10(pid=7911): Launched 01:19:55.079193 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:19:55.295806 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:19:55.614223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7912): Launched 01:19:55.875170 run iperf3-srv_10.42.42.10(pid=7913): Launched 01:19:55.987779 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:19:56.186664 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:19:56.486217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7914): Launched 01:19:56.746857 run iperf3-srv_10.42.42.10(pid=7915): Launched 01:19:56.860478 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:19:57.059566 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:19:57.358419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7916): Launched 01:19:57.619599 run iperf3-srv_10.42.42.10(pid=7917): Launched 01:19:57.732245 tst iperf3m4.py:8: start network... 01:19:57.930980 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:19:58.392465 run create_hlr_db(pid=7918): Launched 01:19:58.507485 bus /gobi_6: Setting Powered False 01:19:59.566510 run create_hlr_db(pid=7918): Terminated: ok {rc=0} 01:19:59.980870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7920): Launched 01:20:00.279398 run osmo-hlr_10.42.42.2(pid=7921): Launched 01:20:00.394571 run osmo-stp_10.42.42.5: Starting osmo-stp 01:20:00.961736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7923): Launched 01:20:01.310405 run osmo-stp_10.42.42.5(pid=7924): Launched 01:20:01.444432 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:20:02.338920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7929): Launched 01:20:02.466225 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:20:02.718162 run patchelf(pid=7930): Launched 01:20:02.884461 run osmo-stp_10.42.42.5(pid=7924): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7924)] 01:20:03.011052 run osmo-stp_10.42.42.5(pid=7924): stdout: | (launched: 2022-12-10_01:20:01.248004) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:20:03.138750 run osmo-stp_10.42.42.5(pid=7924): stderr: | 20221210012001626 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012001627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012001629 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012001630 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012001631 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012001631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012001631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:20:03.266417 run osmo-stp_10.42.42.5(pid=7924): stdout: | (launched: 2022-12-10_01:20:01.248004) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:20:03.388942 run osmo-stp_10.42.42.5(pid=7924): stderr: | 20221210012001626 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012001627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012001629 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012001630 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012001631 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012001631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012001631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:20:03.534219 run patchelf(pid=7930): Terminating (SIGINT) 01:20:03.700697 run patchelf(pid=7930): Terminated: ok {rc=0} 01:20:03.820584 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7924): Process ended prematurely: osmo-stp_10.42.42.5(pid=7924) [trial-2367↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7924)] [trial-2367↪gprs:trx-umtrx↪iperf3m4.py:8] 01:20:03.830057 tst iperf3m4.py:8: Test FAILED (10.8 sec) 01:20:03.857765 run osmo-hlr_10.42.42.2(pid=7921): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7921)] 01:20:03.905591 run osmo-hlr_10.42.42.2(pid=7921): stdout: | (launched: 2022-12-10_01:20:00.224505) 01:20:03.954399 run osmo-hlr_10.42.42.2(pid=7921): stderr: | 20221210012000398 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012000398 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012000398 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012000398 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012000398 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012000398 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012000409 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012000418 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012000418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012000418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:20:04.003717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7910): Terminating (SIGTERM) 01:20:04.043129 run iperf3-srv_10.42.42.10(pid=7911): Terminating (SIGTERM) 01:20:04.082377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7912): Terminating (SIGTERM) 01:20:04.121911 run iperf3-srv_10.42.42.10(pid=7913): Terminating (SIGTERM) 01:20:04.161053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7914): Terminating (SIGTERM) 01:20:04.200155 run iperf3-srv_10.42.42.10(pid=7915): Terminating (SIGTERM) 01:20:04.239344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7916): Terminating (SIGTERM) 01:20:04.278474 run iperf3-srv_10.42.42.10(pid=7917): Terminating (SIGTERM) 01:20:04.317612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7920): Terminating (SIGTERM) 01:20:04.357076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7923): Terminating (SIGTERM) 01:20:04.396421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7929): Terminating (SIGTERM) 01:20:04.435937 --- ParallelTerminationStrategy: PID 7910 died... 01:20:04.454705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7910): Terminated: ok {rc=0} 01:20:04.498363 --- ParallelTerminationStrategy: PID 7911 died... 01:20:04.516444 run iperf3-srv_10.42.42.10(pid=7911): Terminated {rc=256} 01:20:04.559863 --- ParallelTerminationStrategy: PID 7912 died... 01:20:04.578050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7912): Terminated: ok {rc=0} 01:20:04.621608 --- ParallelTerminationStrategy: PID 7913 died... 01:20:04.639854 run iperf3-srv_10.42.42.10(pid=7913): Terminated {rc=256} 01:20:04.683231 --- ParallelTerminationStrategy: PID 7914 died... 01:20:04.701486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7914): Terminated: ok {rc=0} 01:20:04.745102 --- ParallelTerminationStrategy: PID 7915 died... 01:20:04.763279 run iperf3-srv_10.42.42.10(pid=7915): Terminated {rc=256} 01:20:04.806742 --- ParallelTerminationStrategy: PID 7916 died... 01:20:04.825080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7916): Terminated: ok {rc=0} 01:20:04.868542 --- ParallelTerminationStrategy: PID 7917 died... 01:20:04.886780 run iperf3-srv_10.42.42.10(pid=7917): Terminated {rc=256} 01:20:04.931120 --- ParallelTerminationStrategy: PID 7920 died... 01:20:04.949567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7920): Terminated: ok {rc=0} 01:20:04.993072 --- ParallelTerminationStrategy: PID 7923 died... 01:20:05.011464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7923): Terminated: ok {rc=0} 01:20:05.055025 --- ParallelTerminationStrategy: PID 7929 died... 01:20:05.073358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7929): Terminated: ok {rc=0} 01:20:05.156304 bus /gobi_4: Setting Powered False 01:20:06.250647 bus /gobi_4: Setting Powered False 01:20:07.363854 bus /gobi_1: Setting Powered False 01:20:08.460922 bus /gobi_1: Setting Powered False 01:20:09.573291 bus /gobi_0: Setting Powered False 01:20:10.670494 bus /gobi_0: Setting Powered False 01:20:11.784935 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-umtrx ping.py ---------------------------------------------- 01:20:12.886045 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:12.897645 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 01:20:12.946871 tst ping.py: using LAC 24993 01:20:13.070819 tst ping.py: using RAC 3 01:20:13.193113 tst ping.py: using CellId 24993 01:20:13.315645 tst ping.py: using BVCI 24994 01:20:13.429190 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:13.440017 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:13.450946 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:13.461798 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:13.472442 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:13.483138 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:13.493993 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:13.504703 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 01:20:13.620174 tst ping.py:19: start network... 01:20:13.831897 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:20:14.317178 run create_hlr_db(pid=7931): Launched 01:20:14.446153 bus /gobi_6: Setting Powered False 01:20:15.507969 run create_hlr_db(pid=7931): Terminated: ok {rc=0} 01:20:15.957740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7933): Launched 01:20:16.272798 run osmo-hlr_10.42.42.2(pid=7934): Launched 01:20:16.445628 run osmo-stp_10.42.42.5: Starting osmo-stp 01:20:17.167609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7936): Launched 01:20:17.467863 run osmo-stp_10.42.42.5(pid=7937): Launched 01:20:17.581940 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:20:18.086910 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7939): Launched 01:20:18.199146 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:20:18.446398 run patchelf(pid=7940): Launched 01:20:18.610451 run osmo-stp_10.42.42.5(pid=7937): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7937)] 01:20:18.734398 run osmo-stp_10.42.42.5(pid=7937): stdout: | (launched: 2022-12-10_01:20:17.413949) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:20:18.859770 run osmo-stp_10.42.42.5(pid=7937): stderr: | 20221210012017583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012017583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012017583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012017583 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012017584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012017584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012017584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:20:18.985510 run osmo-stp_10.42.42.5(pid=7937): stdout: | (launched: 2022-12-10_01:20:17.413949) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:20:19.106634 run osmo-stp_10.42.42.5(pid=7937): stderr: | 20221210012017583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012017583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012017583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012017583 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012017584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012017584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012017584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:20:19.249421 run patchelf(pid=7940): Terminating (SIGINT) 01:20:19.413307 run patchelf(pid=7940): Terminated: ok {rc=0} 01:20:19.531063 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7937): Process ended prematurely: osmo-stp_10.42.42.5(pid=7937) [trial-2367↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7937)] [trial-2367↪gprs:trx-umtrx↪ping.py:22] 01:20:19.539712 tst ping.py:22: Test FAILED (6.6 sec) 01:20:19.566711 run osmo-hlr_10.42.42.2(pid=7934): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7934)] 01:20:19.613840 run osmo-hlr_10.42.42.2(pid=7934): stdout: | (launched: 2022-12-10_01:20:16.211249) 01:20:19.662754 run osmo-hlr_10.42.42.2(pid=7934): stderr: | 20221210012016558 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012016558 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012016558 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012016558 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012016558 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012016558 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012016576 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012016591 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012016591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012016591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:20:19.712032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7933): Terminating (SIGTERM) 01:20:19.751599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7936): Terminating (SIGTERM) 01:20:19.791188 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7939): Terminating (SIGTERM) 01:20:19.830900 --- ParallelTerminationStrategy: PID 7933 died... 01:20:19.849670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7933): Terminated: ok {rc=0} 01:20:19.893473 --- ParallelTerminationStrategy: PID 7936 died... 01:20:19.911893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7936): Terminated: ok {rc=0} 01:20:19.955396 --- ParallelTerminationStrategy: PID 7939 died... 01:20:19.973732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7939): Terminated: ok {rc=0} 01:20:20.059460 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 01:20:21.147139 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:21.158717 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 01:20:21.208219 tst ping_idle_ping.py: using LAC 24994 01:20:21.325367 tst ping_idle_ping.py: using RAC 4 01:20:21.443538 tst ping_idle_ping.py: using CellId 24994 01:20:21.563514 tst ping_idle_ping.py: using BVCI 24995 01:20:21.672008 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:21.682586 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:21.692939 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:21.703498 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:21.713993 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:21.724444 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:21.735165 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:21.745733 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 01:20:21.859681 tst ping_idle_ping.py:24: start network... 01:20:22.055475 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:20:22.513441 run create_hlr_db(pid=7941): Launched 01:20:22.627131 bus /gobi_6: Setting Powered False 01:20:23.686371 run create_hlr_db(pid=7941): Terminated: ok {rc=0} 01:20:24.098939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7943): Launched 01:20:24.395213 run osmo-hlr_10.42.42.2(pid=7944): Launched 01:20:24.509429 run osmo-stp_10.42.42.5: Starting osmo-stp 01:20:25.015474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7946): Launched 01:20:25.310304 run osmo-stp_10.42.42.5(pid=7947): Launched 01:20:25.423061 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:20:25.928940 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7949): Launched 01:20:26.042076 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:20:26.289949 run patchelf(pid=7950): Launched 01:20:26.453901 run osmo-stp_10.42.42.5(pid=7947): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7947)] 01:20:26.577601 run osmo-stp_10.42.42.5(pid=7947): stdout: | (launched: 2022-12-10_01:20:25.256072) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:20:26.703354 run osmo-stp_10.42.42.5(pid=7947): stderr: | 20221210012025426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012025426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012025427 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012025427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012025428 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012025428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012025428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:20:26.829089 run osmo-stp_10.42.42.5(pid=7947): stdout: | (launched: 2022-12-10_01:20:25.256072) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:20:26.949279 run osmo-stp_10.42.42.5(pid=7947): stderr: | 20221210012025426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012025426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012025427 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012025427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012025428 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012025428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012025428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:20:27.092454 run patchelf(pid=7950): Terminating (SIGINT) 01:20:27.256728 run patchelf(pid=7950): Terminated: ok {rc=0} 01:20:27.374819 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7947): Process ended prematurely: osmo-stp_10.42.42.5(pid=7947) [trial-2367↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7947)] [trial-2367↪gprs:trx-umtrx↪ping_idle_ping.py:27] 01:20:27.383564 tst ping_idle_ping.py:27: Test FAILED (6.2 sec) 01:20:27.410605 run osmo-hlr_10.42.42.2(pid=7944): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7944)] 01:20:27.458450 run osmo-hlr_10.42.42.2(pid=7944): stdout: | (launched: 2022-12-10_01:20:24.340719) 01:20:27.507716 run osmo-hlr_10.42.42.2(pid=7944): stderr: | 20221210012024518 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012024518 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012024518 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012024518 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012024518 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012024518 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012024553 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012024563 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012024563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012024564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:20:27.557401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7943): Terminating (SIGTERM) 01:20:27.597184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7946): Terminating (SIGTERM) 01:20:27.636882 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7949): Terminating (SIGTERM) 01:20:27.676919 --- ParallelTerminationStrategy: PID 7943 died... 01:20:27.696044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7943): Terminated: ok {rc=0} 01:20:27.740774 --- ParallelTerminationStrategy: PID 7946 died... 01:20:27.759436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7946): Terminated: ok {rc=0} 01:20:27.803393 --- ParallelTerminationStrategy: PID 7949 died... 01:20:27.822012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7949): Terminated: ok {rc=0} 01:20:27.905739 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 01:20:29.205651 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:20:29.211740 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 01:20:29.246408 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 01:20:29.285841 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 01:20:29.374236 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 01:20:29.407593 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 01:20:29.447187 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 01:20:30.039130 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 01:20:30.091590 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:30.102780 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:20:30.155201 tst cs_paging_gprs_active.py: using LAC 24995 01:20:30.282808 tst cs_paging_gprs_active.py: using RAC 5 01:20:30.410562 tst cs_paging_gprs_active.py: using CellId 24995 01:20:30.538740 tst cs_paging_gprs_active.py: using BVCI 24996 01:20:30.650430 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:30.661403 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:30.672110 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:30.683032 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:30.693981 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:30.704522 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:30.715350 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:30.725943 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:30.736683 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:20:30.863065 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:20:30.991747 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:20:31.214494 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:20:31.543210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7956): Launched 01:20:31.842920 run iperf3-srv_10.42.42.10(pid=7957): Launched 01:20:32.005021 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:20:32.235389 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:20:32.537083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7958): Launched 01:20:32.798107 run iperf3-srv_10.42.42.10(pid=7959): Launched 01:20:32.911011 tst cs_paging_gprs_active.py:38: start network... 01:20:33.111012 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:20:33.574877 run create_hlr_db(pid=7960): Launched 01:20:33.689543 bus /gobi_6: Setting Powered False 01:20:34.749070 run create_hlr_db(pid=7960): Terminated: ok {rc=0} 01:20:35.166140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7962): Launched 01:20:35.465587 run osmo-hlr_10.42.42.2(pid=7963): Launched 01:20:35.580892 run osmo-stp_10.42.42.5: Starting osmo-stp 01:20:36.097373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7965): Launched 01:20:36.397288 run osmo-stp_10.42.42.5(pid=7966): Launched 01:20:36.512337 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:20:37.027599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7968): Launched 01:20:37.142055 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:20:37.394375 run patchelf(pid=7969): Launched 01:20:37.561411 run osmo-stp_10.42.42.5(pid=7966): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7966)] 01:20:37.688249 run osmo-stp_10.42.42.5(pid=7966): stdout: | (launched: 2022-12-10_01:20:36.342207) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:20:37.816365 run osmo-stp_10.42.42.5(pid=7966): stderr: | 20221210012036512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012036512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012036512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012036513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012036513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012036513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012036513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:20:37.944552 run osmo-stp_10.42.42.5(pid=7966): stdout: | (launched: 2022-12-10_01:20:36.342207) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:20:38.067294 run osmo-stp_10.42.42.5(pid=7966): stderr: | 20221210012036512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012036512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012036512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012036513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012036513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012036513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012036513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:20:38.212488 run patchelf(pid=7969): Terminating (SIGINT) 01:20:38.379663 run patchelf(pid=7969): Terminated: ok {rc=0} 01:20:38.500384 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7966): Process ended prematurely: osmo-stp_10.42.42.5(pid=7966) [trial-2367↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7966)] [trial-2367↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 01:20:38.509786 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 01:20:38.537649 run osmo-hlr_10.42.42.2(pid=7963): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7963)] 01:20:38.585292 run osmo-hlr_10.42.42.2(pid=7963): stdout: | (launched: 2022-12-10_01:20:35.410883) 01:20:38.634396 run osmo-hlr_10.42.42.2(pid=7963): stderr: | 20221210012035586 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012035586 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012035586 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012035586 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012035586 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012035586 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012035599 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012035610 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012035610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012035610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:20:38.684139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7956): Terminating (SIGTERM) 01:20:38.723946 run iperf3-srv_10.42.42.10(pid=7957): Terminating (SIGTERM) 01:20:38.763528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7958): Terminating (SIGTERM) 01:20:38.803285 run iperf3-srv_10.42.42.10(pid=7959): Terminating (SIGTERM) 01:20:38.842792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7962): Terminating (SIGTERM) 01:20:38.882687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7965): Terminating (SIGTERM) 01:20:38.922335 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7968): Terminating (SIGTERM) 01:20:38.962399 --- ParallelTerminationStrategy: PID 7956 died... 01:20:38.981513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7956): Terminated: ok {rc=0} 01:20:39.026029 --- ParallelTerminationStrategy: PID 7957 died... 01:20:39.044353 run iperf3-srv_10.42.42.10(pid=7957): Terminated {rc=256} 01:20:39.088463 --- ParallelTerminationStrategy: PID 7958 died... 01:20:39.106964 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7958): Terminated: ok {rc=0} 01:20:39.151035 --- ParallelTerminationStrategy: PID 7959 died... 01:20:39.169667 run iperf3-srv_10.42.42.10(pid=7959): Terminated {rc=256} 01:20:39.213579 --- ParallelTerminationStrategy: PID 7962 died... 01:20:39.232105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7962): Terminated: ok {rc=0} 01:20:39.275719 --- ParallelTerminationStrategy: PID 7965 died... 01:20:39.294264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7965): Terminated: ok {rc=0} 01:20:39.338228 --- ParallelTerminationStrategy: PID 7968 died... 01:20:39.356763 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7968): Terminated: ok {rc=0} 01:20:39.440161 bus /gobi_0: Setting Powered False 01:20:40.534202 bus /gobi_0: Setting Powered False 01:20:41.648650 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 01:20:42.798551 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:42.810360 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:20:42.864536 tst iperf3.py: using LAC 24996 01:20:42.993541 tst iperf3.py: using RAC 6 01:20:43.121121 tst iperf3.py: using CellId 24996 01:20:43.247586 tst iperf3.py: using BVCI 24997 01:20:43.363728 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:43.375075 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:43.386101 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:43.397078 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:43.407989 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:43.419020 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:43.430218 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:43.441046 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:43.452051 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:20:43.566218 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:20:43.767567 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:20:44.067418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7970): Launched 01:20:44.328566 run iperf3-srv_10.42.42.10(pid=7971): Launched 01:20:44.441831 tst iperf3.py:8: start network... 01:20:44.641218 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:20:45.103467 run create_hlr_db(pid=7972): Launched 01:20:45.218751 bus /gobi_6: Setting Powered False 01:20:46.285723 run create_hlr_db(pid=7972): Terminated: ok {rc=0} 01:20:46.790743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7974): Launched 01:20:47.137700 run osmo-hlr_10.42.42.2(pid=7975): Launched 01:20:47.283516 run osmo-stp_10.42.42.5: Starting osmo-stp 01:20:47.843777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7977): Launched 01:20:48.164225 run osmo-stp_10.42.42.5(pid=7978): Launched 01:20:48.286332 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:20:48.838694 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7980): Launched 01:20:48.961168 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:20:49.231045 run patchelf(pid=7981): Launched 01:20:49.410157 run osmo-stp_10.42.42.5(pid=7978): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7978)] 01:20:49.545114 run osmo-stp_10.42.42.5(pid=7978): stdout: | (launched: 2022-12-10_01:20:48.106146) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:20:49.681734 run osmo-stp_10.42.42.5(pid=7978): stderr: | 20221210012048298 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012048298 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012048298 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012048298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012048301 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012048301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012048301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:20:49.818035 run osmo-stp_10.42.42.5(pid=7978): stdout: | (launched: 2022-12-10_01:20:48.106146) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:20:49.949132 run osmo-stp_10.42.42.5(pid=7978): stderr: | 20221210012048298 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012048298 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012048298 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012048298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012048301 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012048301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012048301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:20:50.104261 run patchelf(pid=7981): Terminating (SIGINT) 01:20:50.282562 run patchelf(pid=7981): Terminated: ok {rc=0} 01:20:50.411176 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7978): Process ended prematurely: osmo-stp_10.42.42.5(pid=7978) [trial-2367↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7978)] [trial-2367↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 01:20:50.420904 tst iperf3.py:8: Test FAILED (7.7 sec) 01:20:50.449761 run osmo-hlr_10.42.42.2(pid=7975): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7975)] 01:20:50.499377 run osmo-hlr_10.42.42.2(pid=7975): stdout: | (launched: 2022-12-10_01:20:47.071087) 01:20:50.550685 run osmo-hlr_10.42.42.2(pid=7975): stderr: | 20221210012047294 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012047294 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012047294 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012047294 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012047294 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012047294 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012047307 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012047317 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012047317 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012047317 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:20:50.602517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7970): Terminating (SIGTERM) 01:20:50.643600 run iperf3-srv_10.42.42.10(pid=7971): Terminating (SIGTERM) 01:20:50.684655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7974): Terminating (SIGTERM) 01:20:50.725789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7977): Terminating (SIGTERM) 01:20:50.766599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7980): Terminating (SIGTERM) 01:20:50.807742 --- ParallelTerminationStrategy: PID 7970 died... 01:20:50.827552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7970): Terminated: ok {rc=0} 01:20:50.872786 --- ParallelTerminationStrategy: PID 7971 died... 01:20:50.892317 run iperf3-srv_10.42.42.10(pid=7971): Terminated {rc=256} 01:20:50.937283 --- ParallelTerminationStrategy: PID 7974 died... 01:20:50.956288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7974): Terminated: ok {rc=0} 01:20:51.002218 --- ParallelTerminationStrategy: PID 7977 died... 01:20:51.021518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7977): Terminated: ok {rc=0} 01:20:51.067181 --- ParallelTerminationStrategy: PID 7980 died... 01:20:51.086544 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7980): Terminated: ok {rc=0} 01:20:51.173177 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 01:20:52.323952 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:52.336091 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:20:52.385030 tst iperf3m4.py: using LAC 24997 01:20:52.513800 tst iperf3m4.py: using RAC 7 01:20:52.631988 tst iperf3m4.py: using CellId 24997 01:20:52.749385 tst iperf3m4.py: using BVCI 24998 01:20:52.857814 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:52.868449 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:52.878998 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:52.889917 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:52.900634 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:52.911470 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:52.922814 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:52.933484 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:52.944263 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:20:53.063212 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:20:53.183436 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:20:53.301933 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:20:53.424220 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:20:53.624923 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:20:53.923916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7982): Launched 01:20:54.184891 run iperf3-srv_10.42.42.10(pid=7983): Launched 01:20:54.297371 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:20:54.496744 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:20:54.795501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7984): Launched 01:20:55.055562 run iperf3-srv_10.42.42.10(pid=7985): Launched 01:20:55.168192 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:20:55.367874 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:20:55.667170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7986): Launched 01:20:55.928110 run iperf3-srv_10.42.42.10(pid=7987): Launched 01:20:56.040700 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:20:56.254334 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:20:56.576287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7988): Launched 01:20:56.856394 run iperf3-srv_10.42.42.10(pid=7989): Launched 01:20:56.976891 tst iperf3m4.py:8: start network... 01:20:57.191926 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:20:57.689683 run create_hlr_db(pid=7990): Launched 01:20:57.822480 bus /gobi_6: Setting Powered False 01:20:58.885799 run create_hlr_db(pid=7990): Terminated: ok {rc=0} 01:20:59.311594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7992): Launched 01:20:59.612353 run osmo-hlr_10.42.42.2(pid=7993): Launched 01:20:59.727156 run osmo-stp_10.42.42.5: Starting osmo-stp 01:21:00.257451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7995): Launched 01:21:00.557496 run osmo-stp_10.42.42.5(pid=7996): Launched 01:21:00.671770 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:21:01.237645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7998): Launched 01:21:01.368310 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:21:01.634363 run patchelf(pid=7999): Launched 01:21:01.819255 run osmo-stp_10.42.42.5(pid=7996): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7996)] 01:21:01.950548 run osmo-stp_10.42.42.5(pid=7996): stdout: | (launched: 2022-12-10_01:21:00.502487) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:21:02.082351 run osmo-stp_10.42.42.5(pid=7996): stderr: | 20221210012100674 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012100674 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012100674 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012100674 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012100675 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012100675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012100675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:21:02.214612 run osmo-stp_10.42.42.5(pid=7996): stdout: | (launched: 2022-12-10_01:21:00.502487) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:21:02.339642 run osmo-stp_10.42.42.5(pid=7996): stderr: | 20221210012100674 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012100674 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012100674 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012100674 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012100675 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012100675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012100675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:21:02.485955 run patchelf(pid=7999): Terminating (SIGINT) 01:21:02.654021 run patchelf(pid=7999): Terminated: ok {rc=0} 01:21:02.774973 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7996): Process ended prematurely: osmo-stp_10.42.42.5(pid=7996) [trial-2367↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7996)] [trial-2367↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 01:21:02.784347 tst iperf3m4.py:8: Test FAILED (10.5 sec) 01:21:02.812178 run osmo-hlr_10.42.42.2(pid=7993): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7993)] 01:21:02.859982 run osmo-hlr_10.42.42.2(pid=7993): stdout: | (launched: 2022-12-10_01:20:59.557512) 01:21:02.909502 run osmo-hlr_10.42.42.2(pid=7993): stderr: | 20221210012059733 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012059733 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012059733 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012059733 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012059733 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012059733 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012059746 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012059754 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012059754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012059754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:21:02.959213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7982): Terminating (SIGTERM) 01:21:02.998874 run iperf3-srv_10.42.42.10(pid=7983): Terminating (SIGTERM) 01:21:03.038553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7984): Terminating (SIGTERM) 01:21:03.078379 run iperf3-srv_10.42.42.10(pid=7985): Terminating (SIGTERM) 01:21:03.117850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7986): Terminating (SIGTERM) 01:21:03.157619 run iperf3-srv_10.42.42.10(pid=7987): Terminating (SIGTERM) 01:21:03.197093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7988): Terminating (SIGTERM) 01:21:03.236554 run iperf3-srv_10.42.42.10(pid=7989): Terminating (SIGTERM) 01:21:03.276259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7992): Terminating (SIGTERM) 01:21:03.315750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7995): Terminating (SIGTERM) 01:21:03.355270 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7998): Terminating (SIGTERM) 01:21:03.395529 --- ParallelTerminationStrategy: PID 7982 died... 01:21:03.414526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7982): Terminated: ok {rc=0} 01:21:03.458459 --- ParallelTerminationStrategy: PID 7983 died... 01:21:03.476878 run iperf3-srv_10.42.42.10(pid=7983): Terminated {rc=256} 01:21:03.520572 --- ParallelTerminationStrategy: PID 7984 died... 01:21:03.539111 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7984): Terminated: ok {rc=0} 01:21:03.582938 --- ParallelTerminationStrategy: PID 7985 died... 01:21:03.601302 run iperf3-srv_10.42.42.10(pid=7985): Terminated {rc=256} 01:21:03.645093 --- ParallelTerminationStrategy: PID 7986 died... 01:21:03.663559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7986): Terminated: ok {rc=0} 01:21:03.707474 --- ParallelTerminationStrategy: PID 7987 died... 01:21:03.725810 run iperf3-srv_10.42.42.10(pid=7987): Terminated {rc=256} 01:21:03.769396 --- ParallelTerminationStrategy: PID 7988 died... 01:21:03.787959 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7988): Terminated: ok {rc=0} 01:21:03.831977 --- ParallelTerminationStrategy: PID 7989 died... 01:21:03.850507 run iperf3-srv_10.42.42.10(pid=7989): Terminated {rc=256} 01:21:03.894296 --- ParallelTerminationStrategy: PID 7992 died... 01:21:03.913062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7992): Terminated: ok {rc=0} 01:21:03.956935 --- ParallelTerminationStrategy: PID 7995 died... 01:21:03.975602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7995): Terminated: ok {rc=0} 01:21:04.019518 --- ParallelTerminationStrategy: PID 7998 died... 01:21:04.038092 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7998): Terminated: ok {rc=0} 01:21:04.123217 bus /gobi_4: Setting Powered False 01:21:05.223017 bus /gobi_4: Setting Powered False 01:21:06.334801 bus /gobi_1: Setting Powered False 01:21:07.432727 bus /gobi_1: Setting Powered False 01:21:08.548803 bus /gobi_0: Setting Powered False 01:21:09.646739 bus /gobi_0: Setting Powered False 01:21:10.762374 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 01:21:11.866679 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:11.878568 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:21:11.930556 tst ping.py: using LAC 24998 01:21:12.054951 tst ping.py: using RAC 8 01:21:12.179865 tst ping.py: using CellId 24998 01:21:12.302842 tst ping.py: using BVCI 24999 01:21:12.417006 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:12.428241 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:12.439298 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:12.450363 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:12.461484 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:12.472423 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:12.483607 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:12.494580 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:21:12.608401 tst ping.py:19: start network... 01:21:12.805098 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:21:13.259770 run create_hlr_db(pid=8000): Launched 01:21:13.373362 bus /gobi_6: Setting Powered False 01:21:14.432573 run create_hlr_db(pid=8000): Terminated: ok {rc=0} 01:21:14.864357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8002): Launched 01:21:15.180366 run osmo-hlr_10.42.42.2(pid=8003): Launched 01:21:15.301741 run osmo-stp_10.42.42.5: Starting osmo-stp 01:21:15.873387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8005): Launched 01:21:16.229651 run osmo-stp_10.42.42.5(pid=8006): Launched 01:21:16.395249 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:21:17.183018 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8008): Launched 01:21:17.319812 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:21:17.569655 run patchelf(pid=8009): Launched 01:21:17.735804 run osmo-stp_10.42.42.5(pid=8006): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8006)] 01:21:17.860623 run osmo-stp_10.42.42.5(pid=8006): stdout: | (launched: 2022-12-10_01:21:16.161641) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:21:17.987399 run osmo-stp_10.42.42.5(pid=8006): stderr: | 20221210012116507 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012116508 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012116508 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012116508 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012116509 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012116509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012116510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:21:18.113913 run osmo-stp_10.42.42.5(pid=8006): stdout: | (launched: 2022-12-10_01:21:16.161641) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:21:18.235548 run osmo-stp_10.42.42.5(pid=8006): stderr: | 20221210012116507 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012116508 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012116508 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012116508 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012116509 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012116509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012116510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:21:18.378500 run patchelf(pid=8009): Terminating (SIGINT) 01:21:18.543482 run patchelf(pid=8009): Terminated: ok {rc=0} 01:21:18.662308 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8006): Process ended prematurely: osmo-stp_10.42.42.5(pid=8006) [trial-2367↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8006)] [trial-2367↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 01:21:18.671025 tst ping.py:22: Test FAILED (6.8 sec) 01:21:18.698181 run osmo-hlr_10.42.42.2(pid=8003): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8003)] 01:21:18.745932 run osmo-hlr_10.42.42.2(pid=8003): stdout: | (launched: 2022-12-10_01:21:15.122541) 01:21:18.795169 run osmo-hlr_10.42.42.2(pid=8003): stderr: | 20221210012115322 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012115322 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012115322 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012115322 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012115322 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012115323 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012115335 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012115344 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012115344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012115344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:21:18.845137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8002): Terminating (SIGTERM) 01:21:18.884887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8005): Terminating (SIGTERM) 01:21:18.924809 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8008): Terminating (SIGTERM) 01:21:18.964726 --- ParallelTerminationStrategy: PID 8002 died... 01:21:18.983862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8002): Terminated: ok {rc=0} 01:21:19.028282 --- ParallelTerminationStrategy: PID 8005 died... 01:21:19.046849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8005): Terminated: ok {rc=0} 01:21:19.090927 --- ParallelTerminationStrategy: PID 8008 died... 01:21:19.109552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8008): Terminated: ok {rc=0} 01:21:19.195953 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 01:21:20.285325 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:20.297141 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:21:20.348324 tst ping_idle_ping.py: using LAC 24999 01:21:20.465029 tst ping_idle_ping.py: using RAC 9 01:21:20.588834 tst ping_idle_ping.py: using CellId 24999 01:21:20.710294 tst ping_idle_ping.py: using BVCI 25000 01:21:20.817884 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:20.828612 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:20.839094 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:20.849855 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:20.860571 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:20.871275 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:20.882268 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:20.893113 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:21:21.010978 tst ping_idle_ping.py:24: start network... 01:21:21.224586 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:21:21.718163 run create_hlr_db(pid=8010): Launched 01:21:21.847380 bus /gobi_6: Setting Powered False 01:21:22.910421 run create_hlr_db(pid=8010): Terminated: ok {rc=0} 01:21:23.350711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8012): Launched 01:21:23.668000 run osmo-hlr_10.42.42.2(pid=8013): Launched 01:21:23.789678 run osmo-stp_10.42.42.5: Starting osmo-stp 01:21:24.333444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8015): Launched 01:21:24.650760 run osmo-stp_10.42.42.5(pid=8016): Launched 01:21:24.772437 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:21:25.318859 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8018): Launched 01:21:25.439944 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:21:25.707615 run patchelf(pid=8019): Launched 01:21:25.884491 run osmo-stp_10.42.42.5(pid=8016): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8016)] 01:21:26.018268 run osmo-stp_10.42.42.5(pid=8016): stdout: | (launched: 2022-12-10_01:21:24.592902) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:21:26.153866 run osmo-stp_10.42.42.5(pid=8016): stderr: | 20221210012124783 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012124784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012124784 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012124784 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012124785 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012124785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012124785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:21:26.289302 run osmo-stp_10.42.42.5(pid=8016): stdout: | (launched: 2022-12-10_01:21:24.592902) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:21:26.419206 run osmo-stp_10.42.42.5(pid=8016): stderr: | 20221210012124783 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012124784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012124784 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012124784 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012124785 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012124785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012124785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:21:26.573050 run patchelf(pid=8019): Terminating (SIGINT) 01:21:26.749576 run patchelf(pid=8019): Terminated: ok {rc=0} 01:21:26.877133 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8016): Process ended prematurely: osmo-stp_10.42.42.5(pid=8016) [trial-2367↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8016)] [trial-2367↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 01:21:26.886449 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 01:21:26.914423 run osmo-hlr_10.42.42.2(pid=8013): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8013)] 01:21:26.963911 run osmo-hlr_10.42.42.2(pid=8013): stdout: | (launched: 2022-12-10_01:21:23.609817) 01:21:27.015239 run osmo-hlr_10.42.42.2(pid=8013): stderr: | 20221210012123809 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012123809 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012123809 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012123809 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012123809 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012123809 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012123822 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012123830 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012123830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012123830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:21:27.067159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8012): Terminating (SIGTERM) 01:21:27.108317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8015): Terminating (SIGTERM) 01:21:27.149989 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8018): Terminating (SIGTERM) 01:21:27.191761 --- ParallelTerminationStrategy: PID 8012 died... 01:21:27.211736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8012): Terminated: ok {rc=0} 01:21:27.257727 --- ParallelTerminationStrategy: PID 8015 died... 01:21:27.276882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8015): Terminated: ok {rc=0} 01:21:27.323161 --- ParallelTerminationStrategy: PID 8018 died... 01:21:27.342717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8018): Terminated: ok {rc=0} 01:21:27.430469 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 01:21:28.736264 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:21:28.743172 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 01:21:28.776052 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 01:21:28.814807 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 01:21:28.902227 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 01:21:28.935053 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 01:21:28.973800 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 01:21:29.569266 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 01:21:29.621631 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:29.632649 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:21:29.702653 tst cs_paging_gprs_active.py: using LAC 25000 01:21:29.830270 tst cs_paging_gprs_active.py: using RAC 10 01:21:29.955845 tst cs_paging_gprs_active.py: using CellId 25000 01:21:30.083385 tst cs_paging_gprs_active.py: using BVCI 25001 01:21:30.199882 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:30.211173 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:30.222200 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:30.233222 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:30.244219 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:30.255239 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:30.266371 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:30.277292 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:30.288368 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:21:30.406743 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:21:30.521206 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:21:30.723028 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:21:31.055399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8025): Launched 01:21:31.361738 run iperf3-srv_10.42.42.10(pid=8026): Launched 01:21:31.496388 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:21:31.720408 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:21:32.057859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8027): Launched 01:21:32.322553 run iperf3-srv_10.42.42.10(pid=8028): Launched 01:21:32.435263 tst cs_paging_gprs_active.py:38: start network... 01:21:32.634463 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:21:33.098160 run create_hlr_db(pid=8029): Launched 01:21:33.213884 bus /gobi_6: Setting Powered False 01:21:34.274303 run create_hlr_db(pid=8029): Terminated: ok {rc=0} 01:21:34.713031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8031): Launched 01:21:35.035200 run osmo-hlr_10.42.42.2(pid=8032): Launched 01:21:35.158557 run osmo-stp_10.42.42.5: Starting osmo-stp 01:21:35.709968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8034): Launched 01:21:36.030176 run osmo-stp_10.42.42.5(pid=8035): Launched 01:21:36.152579 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:21:36.705183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8037): Launched 01:21:36.827771 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:21:37.106304 run patchelf(pid=8038): Launched 01:21:37.284601 run osmo-stp_10.42.42.5(pid=8035): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8035)] 01:21:37.419689 run osmo-stp_10.42.42.5(pid=8035): stdout: | (launched: 2022-12-10_01:21:35.971743) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:21:37.556213 run osmo-stp_10.42.42.5(pid=8035): stderr: | 20221210012136162 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012136162 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012136162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012136163 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012136163 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012136163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012136163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:21:37.693984 run osmo-stp_10.42.42.5(pid=8035): stdout: | (launched: 2022-12-10_01:21:35.971743) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:21:37.825063 run osmo-stp_10.42.42.5(pid=8035): stderr: | 20221210012136162 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012136162 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012136162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012136163 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012136163 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012136163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012136163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:21:37.979881 run patchelf(pid=8038): Terminating (SIGINT) 01:21:38.157988 run patchelf(pid=8038): Terminated: ok {rc=0} 01:21:38.286750 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8035): Process ended prematurely: osmo-stp_10.42.42.5(pid=8035) [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8035)] [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 01:21:38.296640 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 01:21:38.325194 run osmo-hlr_10.42.42.2(pid=8032): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8032)] 01:21:38.374303 run osmo-hlr_10.42.42.2(pid=8032): stdout: | (launched: 2022-12-10_01:21:34.976598) 01:21:38.425334 run osmo-hlr_10.42.42.2(pid=8032): stderr: | 20221210012135173 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012135173 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012135173 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012135173 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012135173 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012135173 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012135185 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012135194 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012135194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012135194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:21:38.476820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8025): Terminating (SIGTERM) 01:21:38.517932 run iperf3-srv_10.42.42.10(pid=8026): Terminating (SIGTERM) 01:21:38.558928 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8027): Terminating (SIGTERM) 01:21:38.599982 run iperf3-srv_10.42.42.10(pid=8028): Terminating (SIGTERM) 01:21:38.640850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8031): Terminating (SIGTERM) 01:21:38.682698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8034): Terminating (SIGTERM) 01:21:38.723833 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8037): Terminating (SIGTERM) 01:21:38.765323 --- ParallelTerminationStrategy: PID 8025 died... 01:21:38.785159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8025): Terminated: ok {rc=0} 01:21:38.830828 --- ParallelTerminationStrategy: PID 8026 died... 01:21:38.850012 run iperf3-srv_10.42.42.10(pid=8026): Terminated {rc=256} 01:21:38.895213 --- ParallelTerminationStrategy: PID 8027 died... 01:21:38.914608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8027): Terminated: ok {rc=0} 01:21:38.960154 --- ParallelTerminationStrategy: PID 8028 died... 01:21:38.979410 run iperf3-srv_10.42.42.10(pid=8028): Terminated {rc=256} 01:21:39.024542 --- ParallelTerminationStrategy: PID 8031 died... 01:21:39.043939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8031): Terminated: ok {rc=0} 01:21:39.089389 --- ParallelTerminationStrategy: PID 8034 died... 01:21:39.108673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8034): Terminated: ok {rc=0} 01:21:39.154055 --- ParallelTerminationStrategy: PID 8037 died... 01:21:39.173360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8037): Terminated: ok {rc=0} 01:21:39.259766 bus /gobi_0: Setting Powered False 01:21:40.357169 bus /gobi_0: Setting Powered False 01:21:41.469662 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 01:21:42.611353 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:42.622868 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:21:42.690846 tst iperf3.py: using LAC 25001 01:21:42.807255 tst iperf3.py: using RAC 11 01:21:42.929186 tst iperf3.py: using CellId 25001 01:21:43.046214 tst iperf3.py: using BVCI 25002 01:21:43.156162 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:43.166994 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:43.177658 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:43.188915 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:43.199769 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:43.210982 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:43.223786 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:43.238204 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:43.249761 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:21:43.373848 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:21:43.574727 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:21:43.875363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8042): Launched 01:21:44.136305 run iperf3-srv_10.42.42.10(pid=8043): Launched 01:21:44.249713 tst iperf3.py:8: start network... 01:21:44.449712 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:21:44.913503 run create_hlr_db(pid=8044): Launched 01:21:45.028072 bus /gobi_6: Setting Powered False 01:21:46.107721 run create_hlr_db(pid=8044): Terminated: ok {rc=0} 01:21:46.547259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8046): Launched 01:21:46.970934 run osmo-hlr_10.42.42.2(pid=8047): Launched 01:21:47.283166 run osmo-stp_10.42.42.5: Starting osmo-stp 01:21:47.956049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8049): Launched 01:21:48.268735 run osmo-stp_10.42.42.5(pid=8050): Launched 01:21:48.389420 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:21:48.930796 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8052): Launched 01:21:49.051201 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:21:49.314786 run patchelf(pid=8053): Launched 01:21:49.489472 run osmo-stp_10.42.42.5(pid=8050): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8050)] 01:21:49.621578 run osmo-stp_10.42.42.5(pid=8050): stdout: | (launched: 2022-12-10_01:21:48.211743) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:21:49.756343 run osmo-stp_10.42.42.5(pid=8050): stderr: | 20221210012148401 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012148401 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012148402 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012148402 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012148403 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012148403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012148403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:21:49.890123 run osmo-stp_10.42.42.5(pid=8050): stdout: | (launched: 2022-12-10_01:21:48.211743) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:21:50.018547 run osmo-stp_10.42.42.5(pid=8050): stderr: | 20221210012148401 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012148401 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012148402 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012148402 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012148403 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012148403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012148403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:21:50.170715 run patchelf(pid=8053): Terminating (SIGINT) 01:21:50.345320 run patchelf(pid=8053): Terminated: ok {rc=0} 01:21:50.471174 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8050): Process ended prematurely: osmo-stp_10.42.42.5(pid=8050) [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8050)] [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 01:21:50.480882 tst iperf3.py:8: Test FAILED (7.9 sec) 01:21:50.509011 run osmo-hlr_10.42.42.2(pid=8047): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8047)] 01:21:50.557836 run osmo-hlr_10.42.42.2(pid=8047): stdout: | (launched: 2022-12-10_01:21:46.894901) 01:21:50.608438 run osmo-hlr_10.42.42.2(pid=8047): stderr: | 20221210012147214 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012147214 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012147214 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012147214 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012147215 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012147215 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012147226 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012147242 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012147242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012147242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:21:50.659360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8042): Terminating (SIGTERM) 01:21:50.700428 run iperf3-srv_10.42.42.10(pid=8043): Terminating (SIGTERM) 01:21:50.741086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8046): Terminating (SIGTERM) 01:21:50.782145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8049): Terminating (SIGTERM) 01:21:50.823028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8052): Terminating (SIGTERM) 01:21:50.864060 --- ParallelTerminationStrategy: PID 8042 died... 01:21:50.883528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8042): Terminated: ok {rc=0} 01:21:50.928756 --- ParallelTerminationStrategy: PID 8043 died... 01:21:50.947929 run iperf3-srv_10.42.42.10(pid=8043): Terminated {rc=256} 01:21:50.992892 --- ParallelTerminationStrategy: PID 8046 died... 01:21:51.012511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8046): Terminated: ok {rc=0} 01:21:51.057555 --- ParallelTerminationStrategy: PID 8049 died... 01:21:51.076534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8049): Terminated: ok {rc=0} 01:21:51.121531 --- ParallelTerminationStrategy: PID 8052 died... 01:21:51.140459 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8052): Terminated: ok {rc=0} 01:21:51.226198 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 01:21:52.370385 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:52.382131 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:21:52.449587 tst iperf3m4.py: using LAC 25002 01:21:52.572530 tst iperf3m4.py: using RAC 12 01:21:52.694452 tst iperf3m4.py: using CellId 25002 01:21:52.816458 tst iperf3m4.py: using BVCI 25003 01:21:52.931651 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:52.942894 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:52.953894 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:52.964792 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:52.975781 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:52.986833 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:52.998021 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:53.008823 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:53.019899 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:21:53.134300 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:21:53.250521 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:21:53.365469 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:21:53.479673 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:21:53.676637 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:21:53.972248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8054): Launched 01:21:54.230044 run iperf3-srv_10.42.42.10(pid=8055): Launched 01:21:54.341292 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:21:54.537991 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:21:54.832487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8056): Launched 01:21:55.089697 run iperf3-srv_10.42.42.10(pid=8057): Launched 01:21:55.201285 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:21:55.398391 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:21:55.694179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8058): Launched 01:21:55.950770 run iperf3-srv_10.42.42.10(pid=8059): Launched 01:21:56.061993 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:21:56.257925 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:21:56.552840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8060): Launched 01:21:56.809207 run iperf3-srv_10.42.42.10(pid=8061): Launched 01:21:56.919934 tst iperf3m4.py:8: start network... 01:21:57.115144 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:21:57.571999 run create_hlr_db(pid=8062): Launched 01:21:57.686159 bus /gobi_6: Setting Powered False 01:21:58.744936 run create_hlr_db(pid=8062): Terminated: ok {rc=0} 01:21:59.173902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8064): Launched 01:21:59.487534 run osmo-hlr_10.42.42.2(pid=8065): Launched 01:21:59.608916 run osmo-stp_10.42.42.5: Starting osmo-stp 01:22:00.148441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8067): Launched 01:22:00.462990 run osmo-stp_10.42.42.5(pid=8068): Launched 01:22:00.584062 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:22:01.157264 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8070): Launched 01:22:01.286224 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:22:01.556192 run patchelf(pid=8071): Launched 01:22:01.736105 run osmo-stp_10.42.42.5(pid=8068): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8068)] 01:22:01.866806 run osmo-stp_10.42.42.5(pid=8068): stdout: | (launched: 2022-12-10_01:22:00.405807) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:22:01.996922 run osmo-stp_10.42.42.5(pid=8068): stderr: | 20221210012200595 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012200595 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012200595 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012200596 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012200596 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012200596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012200596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:22:02.128352 run osmo-stp_10.42.42.5(pid=8068): stdout: | (launched: 2022-12-10_01:22:00.405807) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:22:02.253357 run osmo-stp_10.42.42.5(pid=8068): stderr: | 20221210012200595 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012200595 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012200595 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012200596 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012200596 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012200596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012200596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:22:02.397902 run patchelf(pid=8071): Terminating (SIGINT) 01:22:02.562733 run patchelf(pid=8071): Terminated: ok {rc=0} 01:22:02.682565 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8068): Process ended prematurely: osmo-stp_10.42.42.5(pid=8068) [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8068)] [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 01:22:02.691905 tst iperf3m4.py:8: Test FAILED (10.4 sec) 01:22:02.719778 run osmo-hlr_10.42.42.2(pid=8065): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8065)] 01:22:02.767488 run osmo-hlr_10.42.42.2(pid=8065): stdout: | (launched: 2022-12-10_01:21:59.430385) 01:22:02.817300 run osmo-hlr_10.42.42.2(pid=8065): stderr: | 20221210012159627 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012159627 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012159627 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012159627 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012159627 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012159627 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012159639 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012159648 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012159648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012159648 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:22:02.867049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8054): Terminating (SIGTERM) 01:22:02.907040 run iperf3-srv_10.42.42.10(pid=8055): Terminating (SIGTERM) 01:22:02.946973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8056): Terminating (SIGTERM) 01:22:02.987040 run iperf3-srv_10.42.42.10(pid=8057): Terminating (SIGTERM) 01:22:03.026777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8058): Terminating (SIGTERM) 01:22:03.066852 run iperf3-srv_10.42.42.10(pid=8059): Terminating (SIGTERM) 01:22:03.106423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8060): Terminating (SIGTERM) 01:22:03.146348 run iperf3-srv_10.42.42.10(pid=8061): Terminating (SIGTERM) 01:22:03.185843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8064): Terminating (SIGTERM) 01:22:03.225579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8067): Terminating (SIGTERM) 01:22:03.265154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8070): Terminating (SIGTERM) 01:22:03.305050 --- ParallelTerminationStrategy: PID 8054 died... 01:22:03.324171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8054): Terminated: ok {rc=0} 01:22:03.368380 --- ParallelTerminationStrategy: PID 8055 died... 01:22:03.386787 run iperf3-srv_10.42.42.10(pid=8055): Terminated {rc=256} 01:22:03.430806 --- ParallelTerminationStrategy: PID 8056 died... 01:22:03.449286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8056): Terminated: ok {rc=0} 01:22:03.493232 --- ParallelTerminationStrategy: PID 8057 died... 01:22:03.511694 run iperf3-srv_10.42.42.10(pid=8057): Terminated {rc=256} 01:22:03.555842 --- ParallelTerminationStrategy: PID 8058 died... 01:22:03.574632 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8058): Terminated: ok {rc=0} 01:22:03.618558 --- ParallelTerminationStrategy: PID 8059 died... 01:22:03.636897 run iperf3-srv_10.42.42.10(pid=8059): Terminated {rc=256} 01:22:03.680817 --- ParallelTerminationStrategy: PID 8060 died... 01:22:03.699760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8060): Terminated: ok {rc=0} 01:22:03.743900 --- ParallelTerminationStrategy: PID 8061 died... 01:22:03.762814 run iperf3-srv_10.42.42.10(pid=8061): Terminated {rc=256} 01:22:03.806846 --- ParallelTerminationStrategy: PID 8064 died... 01:22:03.825582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8064): Terminated: ok {rc=0} 01:22:03.870041 --- ParallelTerminationStrategy: PID 8067 died... 01:22:03.888547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8067): Terminated: ok {rc=0} 01:22:03.932522 --- ParallelTerminationStrategy: PID 8070 died... 01:22:03.951051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8070): Terminated: ok {rc=0} 01:22:04.036282 bus /gobi_4: Setting Powered False 01:22:05.135664 bus /gobi_4: Setting Powered False 01:22:06.250777 bus /gobi_1: Setting Powered False 01:22:07.348368 bus /gobi_1: Setting Powered False 01:22:08.462169 bus /gobi_0: Setting Powered False 01:22:09.558004 bus /gobi_0: Setting Powered False 01:22:10.671474 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 01:22:11.773236 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:11.784940 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:22:11.858870 tst ping.py: using LAC 25003 01:22:11.981480 tst ping.py: using RAC 13 01:22:12.094267 tst ping.py: using CellId 25003 01:22:12.206493 tst ping.py: using BVCI 25004 01:22:12.310644 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:12.321487 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:12.332011 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:12.342856 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:12.353544 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:12.364346 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:12.375205 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:12.385995 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:22:12.500797 tst ping.py:19: start network... 01:22:12.708909 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:22:13.191657 run create_hlr_db(pid=8072): Launched 01:22:13.318989 bus /gobi_6: Setting Powered False 01:22:14.381505 run create_hlr_db(pid=8072): Terminated: ok {rc=0} 01:22:14.813770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8074): Launched 01:22:15.123640 run osmo-hlr_10.42.42.2(pid=8075): Launched 01:22:15.242921 run osmo-stp_10.42.42.5: Starting osmo-stp 01:22:15.777481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8077): Launched 01:22:16.122920 run osmo-stp_10.42.42.5(pid=8078): Launched 01:22:16.392631 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:22:16.990896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8080): Launched 01:22:17.116940 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:22:17.381199 run patchelf(pid=8081): Launched 01:22:17.553752 run osmo-stp_10.42.42.5(pid=8078): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8078)] 01:22:17.684877 run osmo-stp_10.42.42.5(pid=8078): stdout: | (launched: 2022-12-10_01:22:16.059967) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:22:17.818341 run osmo-stp_10.42.42.5(pid=8078): stderr: | 20221210012216247 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012216247 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012216247 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012216248 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012216248 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012216248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012216249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:22:17.950906 run osmo-stp_10.42.42.5(pid=8078): stdout: | (launched: 2022-12-10_01:22:16.059967) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:22:18.079651 run osmo-stp_10.42.42.5(pid=8078): stderr: | 20221210012216247 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012216247 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012216247 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012216248 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012216248 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012216248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012216249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:22:18.230629 run patchelf(pid=8081): Terminating (SIGINT) 01:22:18.403345 run patchelf(pid=8081): Terminated: ok {rc=0} 01:22:18.528026 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8078): Process ended prematurely: osmo-stp_10.42.42.5(pid=8078) [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8078)] [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 01:22:18.537470 tst ping.py:22: Test FAILED (6.8 sec) 01:22:18.565294 run osmo-hlr_10.42.42.2(pid=8075): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8075)] 01:22:18.614930 run osmo-hlr_10.42.42.2(pid=8075): stdout: | (launched: 2022-12-10_01:22:15.066943) 01:22:18.666626 run osmo-hlr_10.42.42.2(pid=8075): stderr: | 20221210012215267 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012215267 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012215267 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012215267 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012215267 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012215267 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012215332 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012215341 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012215341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012215341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:22:18.718797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8074): Terminating (SIGTERM) 01:22:18.760367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8077): Terminating (SIGTERM) 01:22:18.802399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8080): Terminating (SIGTERM) 01:22:18.844243 --- ParallelTerminationStrategy: PID 8074 died... 01:22:18.864060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8074): Terminated: ok {rc=0} 01:22:18.910324 --- ParallelTerminationStrategy: PID 8077 died... 01:22:18.929625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8077): Terminated: ok {rc=0} 01:22:18.975252 --- ParallelTerminationStrategy: PID 8080 died... 01:22:18.994582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8080): Terminated: ok {rc=0} 01:22:19.081296 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 01:22:20.169419 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:20.181694 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:22:20.259090 tst ping_idle_ping.py: using LAC 25004 01:22:20.381749 tst ping_idle_ping.py: using RAC 14 01:22:20.502189 tst ping_idle_ping.py: using CellId 25004 01:22:20.622017 tst ping_idle_ping.py: using BVCI 25005 01:22:20.734733 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:20.746074 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:20.757240 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:20.768266 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:20.779264 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:20.790328 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:20.801531 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:20.812611 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:22:20.924466 tst ping_idle_ping.py:24: start network... 01:22:21.118668 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:22:21.567633 run create_hlr_db(pid=8082): Launched 01:22:21.680713 bus /gobi_6: Setting Powered False 01:22:22.739481 run create_hlr_db(pid=8082): Terminated: ok {rc=0} 01:22:23.165212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8084): Launched 01:22:23.475759 run osmo-hlr_10.42.42.2(pid=8085): Launched 01:22:23.595465 run osmo-stp_10.42.42.5: Starting osmo-stp 01:22:24.133115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8087): Launched 01:22:24.444808 run osmo-stp_10.42.42.5(pid=8088): Launched 01:22:24.564319 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:22:25.101977 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8090): Launched 01:22:25.221462 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:22:25.483275 run patchelf(pid=8091): Launched 01:22:25.656752 run osmo-stp_10.42.42.5(pid=8088): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8088)] 01:22:25.789180 run osmo-stp_10.42.42.5(pid=8088): stdout: | (launched: 2022-12-10_01:22:24.388070) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:22:25.922740 run osmo-stp_10.42.42.5(pid=8088): stderr: | 20221210012224578 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012224578 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012224578 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012224579 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012224579 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012224579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012224579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:22:26.056252 run osmo-stp_10.42.42.5(pid=8088): stdout: | (launched: 2022-12-10_01:22:24.388070) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:22:26.184296 run osmo-stp_10.42.42.5(pid=8088): stderr: | 20221210012224578 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012224578 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012224578 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012224579 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012224579 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012224579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012224579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:22:26.335873 run patchelf(pid=8091): Terminating (SIGINT) 01:22:26.509491 run patchelf(pid=8091): Terminated: ok {rc=0} 01:22:26.634737 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8088): Process ended prematurely: osmo-stp_10.42.42.5(pid=8088) [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8088)] [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 01:22:26.644048 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 01:22:26.671871 run osmo-hlr_10.42.42.2(pid=8085): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8085)] 01:22:26.721581 run osmo-hlr_10.42.42.2(pid=8085): stdout: | (launched: 2022-12-10_01:22:23.419222) 01:22:26.772727 run osmo-hlr_10.42.42.2(pid=8085): stderr: | 20221210012223617 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012223617 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012223617 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012223617 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012223617 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012223617 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012223630 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012223638 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012223638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012223638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:22:26.824236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8084): Terminating (SIGTERM) 01:22:26.865519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8087): Terminating (SIGTERM) 01:22:26.906613 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8090): Terminating (SIGTERM) 01:22:26.948052 --- ParallelTerminationStrategy: PID 8084 died... 01:22:26.967724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8084): Terminated: ok {rc=0} 01:22:27.013245 --- ParallelTerminationStrategy: PID 8087 died... 01:22:27.032384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8087): Terminated: ok {rc=0} 01:22:27.077765 --- ParallelTerminationStrategy: PID 8090 died... 01:22:27.097033 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8090): Terminated: ok {rc=0} 01:22:27.182890 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 01:22:28.482627 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:22:28.488757 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 01:22:28.523043 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 01:22:28.561505 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 01:22:28.646476 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 01:22:28.678908 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 01:22:28.717312 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 01:22:29.308708 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 01:22:29.357754 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:29.368486 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:22:29.437354 tst cs_paging_gprs_active.py: using LAC 25005 01:22:29.558378 tst cs_paging_gprs_active.py: using RAC 15 01:22:29.674626 tst cs_paging_gprs_active.py: using CellId 25005 01:22:29.790581 tst cs_paging_gprs_active.py: using BVCI 25006 01:22:29.899188 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:29.910065 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:29.920561 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:29.932262 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:29.944152 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:29.955059 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:29.966504 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:29.977864 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:29.989333 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:22:30.109884 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:22:30.231669 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:22:30.446043 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:22:30.764841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8095): Launched 01:22:31.045201 run iperf3-srv_10.42.42.10(pid=8096): Launched 01:22:31.191738 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:22:31.397673 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:22:31.741559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8097): Launched 01:22:32.100626 run iperf3-srv_10.42.42.10(pid=8098): Launched 01:22:32.231795 tst cs_paging_gprs_active.py:38: start network... 01:22:32.434796 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:22:32.895027 run create_hlr_db(pid=8099): Launched 01:22:33.008600 bus /gobi_6: Setting Powered False 01:22:34.067980 run create_hlr_db(pid=8099): Terminated: ok {rc=0} 01:22:34.500278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8101): Launched 01:22:34.817618 run osmo-hlr_10.42.42.2(pid=8102): Launched 01:22:34.938841 run osmo-stp_10.42.42.5: Starting osmo-stp 01:22:35.488819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8104): Launched 01:22:35.805348 run osmo-stp_10.42.42.5(pid=8105): Launched 01:22:35.932859 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:22:36.482795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8107): Launched 01:22:36.603944 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:22:36.872879 run patchelf(pid=8108): Launched 01:22:37.048683 run osmo-stp_10.42.42.5(pid=8105): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8105)] 01:22:37.181944 run osmo-stp_10.42.42.5(pid=8105): stdout: | (launched: 2022-12-10_01:22:35.747676) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:22:37.316792 run osmo-stp_10.42.42.5(pid=8105): stderr: | 20221210012235958 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012235958 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012235958 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012235959 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012235959 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012235959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012235959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:22:37.452015 run osmo-stp_10.42.42.5(pid=8105): stdout: | (launched: 2022-12-10_01:22:35.747676) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:22:37.581149 run osmo-stp_10.42.42.5(pid=8105): stderr: | 20221210012235958 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012235958 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012235958 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012235959 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012235959 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012235959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012235959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:22:37.734744 run patchelf(pid=8108): Terminating (SIGINT) 01:22:37.911085 run patchelf(pid=8108): Terminated: ok {rc=0} 01:22:38.038532 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8105): Process ended prematurely: osmo-stp_10.42.42.5(pid=8105) [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8105)] [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 01:22:38.048664 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 01:22:38.076936 run osmo-hlr_10.42.42.2(pid=8102): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8102)] 01:22:38.126456 run osmo-hlr_10.42.42.2(pid=8102): stdout: | (launched: 2022-12-10_01:22:34.760245) 01:22:38.177705 run osmo-hlr_10.42.42.2(pid=8102): stderr: | 20221210012234958 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012234958 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012234958 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012234958 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012234958 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012234958 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012234971 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012234981 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012234981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012234981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:22:38.229247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8095): Terminating (SIGTERM) 01:22:38.270534 run iperf3-srv_10.42.42.10(pid=8096): Terminating (SIGTERM) 01:22:38.311722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8097): Terminating (SIGTERM) 01:22:38.353060 run iperf3-srv_10.42.42.10(pid=8098): Terminating (SIGTERM) 01:22:38.394000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8101): Terminating (SIGTERM) 01:22:38.435164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8104): Terminating (SIGTERM) 01:22:38.476684 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8107): Terminating (SIGTERM) 01:22:38.518277 --- ParallelTerminationStrategy: PID 8095 died... 01:22:38.538023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8095): Terminated: ok {rc=0} 01:22:38.584021 --- ParallelTerminationStrategy: PID 8096 died... 01:22:38.603232 run iperf3-srv_10.42.42.10(pid=8096): Terminated {rc=256} 01:22:38.648734 --- ParallelTerminationStrategy: PID 8097 died... 01:22:38.668105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8097): Terminated: ok {rc=0} 01:22:38.714074 --- ParallelTerminationStrategy: PID 8098 died... 01:22:38.733331 run iperf3-srv_10.42.42.10(pid=8098): Terminated {rc=256} 01:22:38.778466 --- ParallelTerminationStrategy: PID 8101 died... 01:22:38.797875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8101): Terminated: ok {rc=0} 01:22:38.843365 --- ParallelTerminationStrategy: PID 8104 died... 01:22:38.862758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8104): Terminated: ok {rc=0} 01:22:38.908208 --- ParallelTerminationStrategy: PID 8107 died... 01:22:38.927624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8107): Terminated: ok {rc=0} 01:22:39.014339 bus /gobi_0: Setting Powered False 01:22:40.112566 bus /gobi_0: Setting Powered False 01:22:41.228349 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 01:22:42.372807 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:42.384272 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:22:42.453990 tst iperf3.py: using LAC 25006 01:22:42.573416 tst iperf3.py: using RAC 16 01:22:42.692480 tst iperf3.py: using CellId 25006 01:22:42.813930 tst iperf3.py: using BVCI 25007 01:22:42.922470 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:42.933275 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:42.943838 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:42.955268 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:42.966613 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:42.977967 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:42.989699 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:43.000920 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:43.012366 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:22:43.130442 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:22:43.343414 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:22:43.660301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8109): Launched 01:22:43.935802 run iperf3-srv_10.42.42.10(pid=8110): Launched 01:22:44.054692 tst iperf3.py:8: start network... 01:22:44.266466 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:22:44.754761 run create_hlr_db(pid=8111): Launched 01:22:44.884268 bus /gobi_6: Setting Powered False 01:22:45.963357 run create_hlr_db(pid=8111): Terminated: ok {rc=0} 01:22:46.425898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8113): Launched 01:22:46.759254 run osmo-hlr_10.42.42.2(pid=8114): Launched 01:22:47.012351 run osmo-stp_10.42.42.5: Starting osmo-stp 01:22:47.572525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8116): Launched 01:22:47.868662 run osmo-stp_10.42.42.5(pid=8117): Launched 01:22:47.981740 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:22:48.490274 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8119): Launched 01:22:48.603272 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:22:48.852666 run patchelf(pid=8120): Launched 01:22:49.017320 run osmo-stp_10.42.42.5(pid=8117): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8117)] 01:22:49.142045 run osmo-stp_10.42.42.5(pid=8117): stdout: | (launched: 2022-12-10_01:22:47.814642) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:22:49.268165 run osmo-stp_10.42.42.5(pid=8117): stderr: | 20221210012247984 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012247984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012247985 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012247985 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012247986 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012247986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012247986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:22:49.394393 run osmo-stp_10.42.42.5(pid=8117): stdout: | (launched: 2022-12-10_01:22:47.814642) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:22:49.515115 run osmo-stp_10.42.42.5(pid=8117): stderr: | 20221210012247984 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012247984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012247985 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012247985 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012247986 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012247986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012247986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:22:49.658455 run patchelf(pid=8120): Terminating (SIGINT) 01:22:49.823612 run patchelf(pid=8120): Terminated: ok {rc=0} 01:22:49.943086 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8117): Process ended prematurely: osmo-stp_10.42.42.5(pid=8117) [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8117)] [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 01:22:49.952394 tst iperf3.py:8: Test FAILED (7.6 sec) 01:22:49.979779 run osmo-hlr_10.42.42.2(pid=8114): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8114)] 01:22:50.026767 run osmo-hlr_10.42.42.2(pid=8114): stdout: | (launched: 2022-12-10_01:22:46.697901) 01:22:50.075434 run osmo-hlr_10.42.42.2(pid=8114): stderr: | 20221210012246972 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012246972 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012246972 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012246972 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012246972 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012246972 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012246987 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012246996 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012246997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012246997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:22:50.125174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8109): Terminating (SIGTERM) 01:22:50.164424 run iperf3-srv_10.42.42.10(pid=8110): Terminating (SIGTERM) 01:22:50.203481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8113): Terminating (SIGTERM) 01:22:50.242978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8116): Terminating (SIGTERM) 01:22:50.282238 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8119): Terminating (SIGTERM) 01:22:50.321452 --- ParallelTerminationStrategy: PID 8109 died... 01:22:50.340031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8109): Terminated: ok {rc=0} 01:22:50.383732 --- ParallelTerminationStrategy: PID 8110 died... 01:22:50.401910 run iperf3-srv_10.42.42.10(pid=8110): Terminated {rc=256} 01:22:50.445448 --- ParallelTerminationStrategy: PID 8113 died... 01:22:50.463694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8113): Terminated: ok {rc=0} 01:22:50.507434 --- ParallelTerminationStrategy: PID 8116 died... 01:22:50.525770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8116): Terminated: ok {rc=0} 01:22:50.569233 --- ParallelTerminationStrategy: PID 8119 died... 01:22:50.587487 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8119): Terminated: ok {rc=0} 01:22:50.671505 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 01:22:51.816939 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:51.828751 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:22:51.898328 tst iperf3m4.py: using LAC 25007 01:22:52.014885 tst iperf3m4.py: using RAC 17 01:22:52.129763 tst iperf3m4.py: using CellId 25007 01:22:52.246686 tst iperf3m4.py: using BVCI 25008 01:22:52.354846 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:52.365833 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:52.376426 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:52.387236 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:52.398016 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:52.408755 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:52.419792 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:52.430543 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:52.441654 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:22:52.561243 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:22:52.677049 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:22:52.794676 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:22:52.908692 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:22:53.106120 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:22:53.401440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8121): Launched 01:22:53.659652 run iperf3-srv_10.42.42.10(pid=8122): Launched 01:22:53.771338 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:22:53.966874 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:22:54.261563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8123): Launched 01:22:54.519881 run iperf3-srv_10.42.42.10(pid=8124): Launched 01:22:54.631195 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:22:54.827422 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:22:55.122557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8125): Launched 01:22:55.379151 run iperf3-srv_10.42.42.10(pid=8126): Launched 01:22:55.490205 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:22:55.685874 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:22:55.981578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8127): Launched 01:22:56.240103 run iperf3-srv_10.42.42.10(pid=8128): Launched 01:22:56.351842 tst iperf3m4.py:8: start network... 01:22:56.548238 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:22:57.004349 run create_hlr_db(pid=8129): Launched 01:22:57.117973 bus /gobi_6: Setting Powered False 01:22:58.177298 run create_hlr_db(pid=8129): Terminated: ok {rc=0} 01:22:58.608892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8131): Launched 01:22:58.925591 run osmo-hlr_10.42.42.2(pid=8132): Launched 01:22:59.048163 run osmo-stp_10.42.42.5: Starting osmo-stp 01:22:59.592237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8134): Launched 01:22:59.908218 run osmo-stp_10.42.42.5(pid=8135): Launched 01:23:00.029627 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:23:00.574575 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8137): Launched 01:23:00.695244 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:23:01.003105 run patchelf(pid=8138): Launched 01:23:01.176306 run osmo-stp_10.42.42.5(pid=8135): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8135)] 01:23:01.308057 run osmo-stp_10.42.42.5(pid=8135): stdout: | (launched: 2022-12-10_01:22:59.850607) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:23:01.439379 run osmo-stp_10.42.42.5(pid=8135): stderr: | 20221210012300040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012300040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012300040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012300041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012300041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012300041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012300041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:23:01.573305 run osmo-stp_10.42.42.5(pid=8135): stdout: | (launched: 2022-12-10_01:22:59.850607) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:23:01.700513 run osmo-stp_10.42.42.5(pid=8135): stderr: | 20221210012300040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012300040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012300040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012300041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012300041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012300041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012300041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:23:01.850460 run patchelf(pid=8138): Terminating (SIGINT) 01:23:02.021451 run patchelf(pid=8138): Terminated: ok {rc=0} 01:23:02.145569 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8135): Process ended prematurely: osmo-stp_10.42.42.5(pid=8135) [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8135)] [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 01:23:02.156317 tst iperf3m4.py:8: Test FAILED (10.4 sec) 01:23:02.187159 run osmo-hlr_10.42.42.2(pid=8132): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8132)] 01:23:02.236657 run osmo-hlr_10.42.42.2(pid=8132): stdout: | (launched: 2022-12-10_01:22:58.868080) 01:23:02.287626 run osmo-hlr_10.42.42.2(pid=8132): stderr: | 20221210012259064 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012259064 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012259064 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012259064 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012259064 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012259064 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012259077 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012259085 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012259085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012259085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:23:02.338362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8121): Terminating (SIGTERM) 01:23:02.378759 run iperf3-srv_10.42.42.10(pid=8122): Terminating (SIGTERM) 01:23:02.419748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8123): Terminating (SIGTERM) 01:23:02.460314 run iperf3-srv_10.42.42.10(pid=8124): Terminating (SIGTERM) 01:23:02.500513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8125): Terminating (SIGTERM) 01:23:02.541023 run iperf3-srv_10.42.42.10(pid=8126): Terminating (SIGTERM) 01:23:02.581221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8127): Terminating (SIGTERM) 01:23:02.621638 run iperf3-srv_10.42.42.10(pid=8128): Terminating (SIGTERM) 01:23:02.661811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8131): Terminating (SIGTERM) 01:23:02.702060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8134): Terminating (SIGTERM) 01:23:02.742514 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8137): Terminating (SIGTERM) 01:23:02.782563 --- ParallelTerminationStrategy: PID 8121 died... 01:23:02.801138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8121): Terminated: ok {rc=0} 01:23:02.845319 --- ParallelTerminationStrategy: PID 8122 died... 01:23:02.863912 run iperf3-srv_10.42.42.10(pid=8122): Terminated {rc=256} 01:23:02.908249 --- ParallelTerminationStrategy: PID 8123 died... 01:23:02.926912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8123): Terminated: ok {rc=0} 01:23:02.971004 --- ParallelTerminationStrategy: PID 8124 died... 01:23:02.989470 run iperf3-srv_10.42.42.10(pid=8124): Terminated {rc=256} 01:23:03.033312 --- ParallelTerminationStrategy: PID 8125 died... 01:23:03.051894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8125): Terminated: ok {rc=0} 01:23:03.096388 --- ParallelTerminationStrategy: PID 8126 died... 01:23:03.114933 run iperf3-srv_10.42.42.10(pid=8126): Terminated {rc=256} 01:23:03.159066 --- ParallelTerminationStrategy: PID 8127 died... 01:23:03.177637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8127): Terminated: ok {rc=0} 01:23:03.221712 --- ParallelTerminationStrategy: PID 8128 died... 01:23:03.240331 run iperf3-srv_10.42.42.10(pid=8128): Terminated {rc=256} 01:23:03.285083 --- ParallelTerminationStrategy: PID 8131 died... 01:23:03.303721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8131): Terminated: ok {rc=0} 01:23:03.348310 --- ParallelTerminationStrategy: PID 8134 died... 01:23:03.366918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8134): Terminated: ok {rc=0} 01:23:03.411551 --- ParallelTerminationStrategy: PID 8137 died... 01:23:03.430483 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8137): Terminated: ok {rc=0} 01:23:03.515954 bus /gobi_4: Setting Powered False 01:23:04.614884 bus /gobi_4: Setting Powered False 01:23:05.730057 bus /gobi_1: Setting Powered False 01:23:06.831056 bus /gobi_1: Setting Powered False 01:23:07.948197 bus /gobi_0: Setting Powered False 01:23:09.049153 bus /gobi_0: Setting Powered False 01:23:10.164278 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 01:23:11.267369 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:11.279420 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:23:11.350644 tst ping.py: using LAC 25008 01:23:11.474080 tst ping.py: using RAC 18 01:23:11.596100 tst ping.py: using CellId 25008 01:23:11.717401 tst ping.py: using BVCI 25009 01:23:11.830455 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:11.841634 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:11.852688 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:11.863778 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:11.874745 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:11.885857 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:11.896934 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:11.908016 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:23:12.021498 tst ping.py:19: start network... 01:23:12.214455 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:23:12.666057 run create_hlr_db(pid=8139): Launched 01:23:12.795850 bus /gobi_6: Setting Powered False 01:23:13.858484 run create_hlr_db(pid=8139): Terminated: ok {rc=0} 01:23:14.273777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8141): Launched 01:23:14.564814 run osmo-hlr_10.42.42.2(pid=8142): Launched 01:23:14.676052 run osmo-stp_10.42.42.5: Starting osmo-stp 01:23:15.187965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8144): Launched 01:23:15.477975 run osmo-stp_10.42.42.5(pid=8145): Launched 01:23:15.587927 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:23:16.169169 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8175): Launched 01:23:16.304122 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:23:16.560665 run patchelf(pid=8184): Launched 01:23:16.758270 run osmo-stp_10.42.42.5(pid=8145): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8145)] 01:23:16.900704 run osmo-stp_10.42.42.5(pid=8145): stdout: | (launched: 2022-12-10_01:23:15.424814) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:23:17.027982 run osmo-stp_10.42.42.5(pid=8145): stderr: | 20221210012315593 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012315594 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012315594 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012315594 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012315595 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012315595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012315595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:23:17.160221 run osmo-stp_10.42.42.5(pid=8145): stdout: | (launched: 2022-12-10_01:23:15.424814) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:23:17.303239 run osmo-stp_10.42.42.5(pid=8145): stderr: | 20221210012315593 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012315594 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012315594 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012315594 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012315595 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012315595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012315595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:23:17.460205 run patchelf(pid=8184): Terminating (SIGINT) 01:23:17.643089 run patchelf(pid=8184): Terminated: ok {rc=0} 01:23:17.779363 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8145): Process ended prematurely: osmo-stp_10.42.42.5(pid=8145) [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8145)] [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 01:23:17.789398 tst ping.py:22: Test FAILED (6.5 sec) 01:23:17.819930 run osmo-hlr_10.42.42.2(pid=8142): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8142)] 01:23:17.877503 run osmo-hlr_10.42.42.2(pid=8142): stdout: | (launched: 2022-12-10_01:23:14.511123) 01:23:17.940289 run osmo-hlr_10.42.42.2(pid=8142): stderr: | 20221210012314687 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012314687 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012314687 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012314687 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012314687 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012314687 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012314700 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012314709 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012314710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012314710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:23:18.002515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8141): Terminating (SIGTERM) 01:23:18.057266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8144): Terminating (SIGTERM) 01:23:18.109877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8175): Terminating (SIGTERM) 01:23:18.154400 --- ParallelTerminationStrategy: PID 8141 died... 01:23:18.179716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8141): Terminated: ok {rc=0} 01:23:18.233813 --- ParallelTerminationStrategy: PID 8144 died... 01:23:18.260154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8144): Terminated: ok {rc=0} 01:23:18.318858 --- ParallelTerminationStrategy: PID 8175 died... 01:23:18.338539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8175): Terminated: ok {rc=0} 01:23:18.441209 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 01:23:19.537736 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:19.550464 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:23:19.625492 tst ping_idle_ping.py: using LAC 25009 01:23:19.751244 tst ping_idle_ping.py: using RAC 19 01:23:19.876548 tst ping_idle_ping.py: using CellId 25009 01:23:20.002798 tst ping_idle_ping.py: using BVCI 25010 01:23:20.122468 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:20.134876 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:20.148363 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:20.161167 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:20.173260 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:20.185436 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:20.197939 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:20.210299 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:23:20.331879 tst ping_idle_ping.py:24: start network... 01:23:20.546354 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:23:21.044315 run create_hlr_db(pid=8419): Launched 01:23:21.200780 bus /gobi_6: Setting Powered False 01:23:22.261185 run create_hlr_db(pid=8419): Terminated: ok {rc=0} 01:23:22.687477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8423): Launched 01:23:23.005045 run osmo-hlr_10.42.42.2(pid=8424): Launched 01:23:23.248394 run osmo-stp_10.42.42.5: Starting osmo-stp 01:23:23.938755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8426): Launched 01:23:24.276145 run osmo-stp_10.42.42.5(pid=8427): Launched 01:23:24.520407 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:23:25.157356 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8429): Launched 01:23:25.291528 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:23:25.564538 run patchelf(pid=8430): Launched 01:23:25.756795 run osmo-stp_10.42.42.5(pid=8427): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8427)] 01:23:25.894112 run osmo-stp_10.42.42.5(pid=8427): stdout: | (launched: 2022-12-10_01:23:24.213440) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:23:26.032472 run osmo-stp_10.42.42.5(pid=8427): stderr: | 20221210012324510 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012324510 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012324510 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012324511 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012324511 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012324511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012324511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:23:26.171541 run osmo-stp_10.42.42.5(pid=8427): stdout: | (launched: 2022-12-10_01:23:24.213440) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:23:26.304538 run osmo-stp_10.42.42.5(pid=8427): stderr: | 20221210012324510 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012324510 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012324510 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012324511 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012324511 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012324511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012324511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:23:26.463334 run patchelf(pid=8430): Terminating (SIGINT) 01:23:26.645147 run patchelf(pid=8430): Terminated: ok {rc=0} 01:23:26.776629 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8427): Process ended prematurely: osmo-stp_10.42.42.5(pid=8427) [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8427)] [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 01:23:26.787491 tst ping_idle_ping.py:27: Test FAILED (7.2 sec) 01:23:26.817592 run osmo-hlr_10.42.42.2(pid=8424): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8424)] 01:23:26.869311 run osmo-hlr_10.42.42.2(pid=8424): stdout: | (launched: 2022-12-10_01:23:22.943641) 01:23:26.922679 run osmo-hlr_10.42.42.2(pid=8424): stderr: | 20221210012323281 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012323281 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012323281 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012323282 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012323282 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012323282 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012323297 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012323312 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012323313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012323313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:23:26.977105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8423): Terminating (SIGTERM) 01:23:27.020437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8426): Terminating (SIGTERM) 01:23:27.065031 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8429): Terminating (SIGTERM) 01:23:27.110762 --- ParallelTerminationStrategy: PID 8423 died... 01:23:27.131654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8423): Terminated: ok {rc=0} 01:23:27.181112 --- ParallelTerminationStrategy: PID 8426 died... 01:23:27.201624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8426): Terminated: ok {rc=0} 01:23:27.248902 --- ParallelTerminationStrategy: PID 8429 died... 01:23:27.269462 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8429): Terminated: ok {rc=0} 01:23:27.360059 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 01:23:28.678055 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:23:28.685915 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 01:23:28.721323 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 01:23:28.762461 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 01:23:28.853061 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 01:23:28.887399 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 01:23:28.928181 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 01:23:29.537090 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 01:23:29.592891 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:29.606101 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:23:29.664787 tst cs_paging_gprs_active.py: using LAC 25010 01:23:29.794513 tst cs_paging_gprs_active.py: using RAC 20 01:23:29.921349 tst cs_paging_gprs_active.py: using CellId 25010 01:23:30.048602 tst cs_paging_gprs_active.py: using BVCI 25011 01:23:30.169136 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:30.182118 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:30.194846 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:30.208073 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:30.220562 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:30.233254 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:30.246563 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:30.260355 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:30.273175 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:23:30.396501 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:23:30.522456 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:23:30.749611 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:23:31.133090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8434): Launched 01:23:31.429682 run iperf3-srv_10.42.42.10(pid=8435): Launched 01:23:31.569399 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:23:31.792725 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:23:32.124024 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8436): Launched 01:23:32.437344 run iperf3-srv_10.42.42.10(pid=8437): Launched 01:23:32.592314 tst cs_paging_gprs_active.py:38: start network... 01:23:32.836456 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:23:33.381869 run create_hlr_db(pid=8438): Launched 01:23:33.547989 bus /gobi_6: Setting Powered False 01:23:34.614971 run create_hlr_db(pid=8438): Terminated: ok {rc=0} 01:23:35.078685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8440): Launched 01:23:35.423862 run osmo-hlr_10.42.42.2(pid=8441): Launched 01:23:35.674417 run osmo-stp_10.42.42.5: Starting osmo-stp 01:23:36.353727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8443): Launched 01:23:36.702195 run osmo-stp_10.42.42.5(pid=8444): Launched 01:23:36.951943 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:23:37.603849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8446): Launched 01:23:37.743183 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:23:38.026166 run patchelf(pid=8447): Launched 01:23:38.223975 run osmo-stp_10.42.42.5(pid=8444): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8444)] 01:23:38.364804 run osmo-stp_10.42.42.5(pid=8444): stdout: | (launched: 2022-12-10_01:23:36.638809) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:23:38.508270 run osmo-stp_10.42.42.5(pid=8444): stderr: | 20221210012336935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012336935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012336936 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012336936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012336937 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012336937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012336937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:23:38.652836 run osmo-stp_10.42.42.5(pid=8444): stdout: | (launched: 2022-12-10_01:23:36.638809) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:23:38.790069 run osmo-stp_10.42.42.5(pid=8444): stderr: | 20221210012336935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012336935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012336936 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012336936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012336937 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012336937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012336937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:23:38.952277 run patchelf(pid=8447): Terminating (SIGINT) 01:23:39.137666 run patchelf(pid=8447): Terminated: ok {rc=0} 01:23:39.272676 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8444): Process ended prematurely: osmo-stp_10.42.42.5(pid=8444) [trial-2367↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8444)] [trial-2367↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 01:23:39.284053 tst cs_paging_gprs_active.py:38: Test FAILED (9.7 sec) 01:23:39.314518 run osmo-hlr_10.42.42.2(pid=8441): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8441)] 01:23:39.366923 run osmo-hlr_10.42.42.2(pid=8441): stdout: | (launched: 2022-12-10_01:23:35.361546) 01:23:39.420170 run osmo-hlr_10.42.42.2(pid=8441): stderr: | 20221210012335680 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012335680 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012335680 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012335680 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012335680 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012335680 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012335695 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012335703 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012335703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012335703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:23:39.475326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8434): Terminating (SIGTERM) 01:23:39.518759 run iperf3-srv_10.42.42.10(pid=8435): Terminating (SIGTERM) 01:23:39.565427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8436): Terminating (SIGTERM) 01:23:39.610862 run iperf3-srv_10.42.42.10(pid=8437): Terminating (SIGTERM) 01:23:39.658240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8440): Terminating (SIGTERM) 01:23:39.703072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8443): Terminating (SIGTERM) 01:23:39.748233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8446): Terminating (SIGTERM) 01:23:39.793590 --- ParallelTerminationStrategy: PID 8434 died... 01:23:39.814143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8434): Terminated: ok {rc=0} 01:23:39.863846 --- ParallelTerminationStrategy: PID 8435 died... 01:23:39.884353 run iperf3-srv_10.42.42.10(pid=8435): Terminated {rc=256} 01:23:39.931852 --- ParallelTerminationStrategy: PID 8436 died... 01:23:39.953807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8436): Terminated: ok {rc=0} 01:23:40.001392 --- ParallelTerminationStrategy: PID 8437 died... 01:23:40.022092 run iperf3-srv_10.42.42.10(pid=8437): Terminated {rc=256} 01:23:40.070362 --- ParallelTerminationStrategy: PID 8440 died... 01:23:40.091168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8440): Terminated: ok {rc=0} 01:23:40.138389 --- ParallelTerminationStrategy: PID 8443 died... 01:23:40.159366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8443): Terminated: ok {rc=0} 01:23:40.208020 --- ParallelTerminationStrategy: PID 8446 died... 01:23:40.228580 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8446): Terminated: ok {rc=0} 01:23:40.319894 bus /gobi_0: Setting Powered False 01:23:41.418467 bus /gobi_0: Setting Powered False 01:23:42.531095 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 01:23:43.678566 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:43.690920 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:23:43.747086 tst iperf3.py: using LAC 25011 01:23:43.872233 tst iperf3.py: using RAC 21 01:23:43.997403 tst iperf3.py: using CellId 25011 01:23:44.123382 tst iperf3.py: using BVCI 25012 01:23:44.234709 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:44.246413 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:44.257789 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:44.269456 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:44.280787 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:44.292168 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:44.303590 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:44.314946 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:44.326414 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:23:44.443494 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:23:44.661041 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:23:44.982924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8449): Launched 01:23:45.262498 run iperf3-srv_10.42.42.10(pid=8450): Launched 01:23:45.385555 tst iperf3.py:8: start network... 01:23:45.601709 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:23:46.130822 run create_hlr_db(pid=8451): Launched 01:23:46.288712 bus /gobi_6: Setting Powered False 01:23:47.347301 run create_hlr_db(pid=8451): Terminated: ok {rc=0} 01:23:47.797663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8453): Launched 01:23:48.120129 run osmo-hlr_10.42.42.2(pid=8454): Launched 01:23:48.243418 run osmo-stp_10.42.42.5: Starting osmo-stp 01:23:48.800833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8456): Launched 01:23:49.121600 run osmo-stp_10.42.42.5(pid=8457): Launched 01:23:49.243727 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:23:49.799827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8459): Launched 01:23:49.922202 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:23:50.195517 run patchelf(pid=8460): Launched 01:23:50.374323 run osmo-stp_10.42.42.5(pid=8457): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8457)] 01:23:50.510100 run osmo-stp_10.42.42.5(pid=8457): stdout: | (launched: 2022-12-10_01:23:49.062435) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:23:50.647504 run osmo-stp_10.42.42.5(pid=8457): stderr: | 20221210012349257 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012349257 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012349257 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012349258 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012349258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012349258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012349258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:23:50.786311 run osmo-stp_10.42.42.5(pid=8457): stdout: | (launched: 2022-12-10_01:23:49.062435) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:23:50.918735 run osmo-stp_10.42.42.5(pid=8457): stderr: | 20221210012349257 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012349257 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012349257 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012349258 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012349258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012349258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012349258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:23:51.075221 run patchelf(pid=8460): Terminating (SIGINT) 01:23:51.254640 run patchelf(pid=8460): Terminated: ok {rc=0} 01:23:51.384135 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8457): Process ended prematurely: osmo-stp_10.42.42.5(pid=8457) [trial-2367↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8457)] [trial-2367↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 01:23:51.394301 tst iperf3.py:8: Test FAILED (7.8 sec) 01:23:51.423675 run osmo-hlr_10.42.42.2(pid=8454): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8454)] 01:23:51.474123 run osmo-hlr_10.42.42.2(pid=8454): stdout: | (launched: 2022-12-10_01:23:48.061761) 01:23:51.526239 run osmo-hlr_10.42.42.2(pid=8454): stderr: | 20221210012348262 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012348262 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012348262 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012348262 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012348262 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012348262 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012348274 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012348282 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012348282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012348282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:23:51.578623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8449): Terminating (SIGTERM) 01:23:51.620718 run iperf3-srv_10.42.42.10(pid=8450): Terminating (SIGTERM) 01:23:51.662545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8453): Terminating (SIGTERM) 01:23:51.704428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8456): Terminating (SIGTERM) 01:23:51.746686 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8459): Terminating (SIGTERM) 01:23:51.788684 --- ParallelTerminationStrategy: PID 8449 died... 01:23:51.808619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8449): Terminated: ok {rc=0} 01:23:51.855440 --- ParallelTerminationStrategy: PID 8450 died... 01:23:51.874680 run iperf3-srv_10.42.42.10(pid=8450): Terminated {rc=256} 01:23:51.921190 --- ParallelTerminationStrategy: PID 8453 died... 01:23:51.940502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8453): Terminated: ok {rc=0} 01:23:51.987093 --- ParallelTerminationStrategy: PID 8456 died... 01:23:52.006438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8456): Terminated: ok {rc=0} 01:23:52.053112 --- ParallelTerminationStrategy: PID 8459 died... 01:23:52.072332 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8459): Terminated: ok {rc=0} 01:23:52.161066 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 01:23:53.310388 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:53.322959 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:23:53.376407 tst iperf3m4.py: using LAC 25012 01:23:53.501744 tst iperf3m4.py: using RAC 22 01:23:53.627811 tst iperf3m4.py: using CellId 25012 01:23:53.754775 tst iperf3m4.py: using BVCI 25013 01:23:53.870992 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:53.882797 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:53.894367 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:53.905900 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:53.917496 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:53.928903 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:53.940581 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:53.951983 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:53.963666 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:23:54.081908 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:23:54.200936 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:23:54.317603 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:23:54.433761 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:23:54.634800 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:23:54.935915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8461): Launched 01:23:55.197950 run iperf3-srv_10.42.42.10(pid=8462): Launched 01:23:55.315152 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:23:55.515410 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:23:55.816759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8463): Launched 01:23:56.078613 run iperf3-srv_10.42.42.10(pid=8464): Launched 01:23:56.191895 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:23:56.392309 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:23:56.693205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8465): Launched 01:23:56.955000 run iperf3-srv_10.42.42.10(pid=8466): Launched 01:23:57.068315 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:23:57.268594 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:23:57.569192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8467): Launched 01:23:57.831283 run iperf3-srv_10.42.42.10(pid=8468): Launched 01:23:57.944633 tst iperf3m4.py:8: start network... 01:23:58.145220 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:23:58.610528 run create_hlr_db(pid=8469): Launched 01:23:58.727315 bus /gobi_6: Setting Powered False 01:23:59.787170 run create_hlr_db(pid=8469): Terminated: ok {rc=0} 01:24:00.206064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8471): Launched 01:24:00.507663 run osmo-hlr_10.42.42.2(pid=8472): Launched 01:24:00.623545 run osmo-stp_10.42.42.5: Starting osmo-stp 01:24:01.201876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8474): Launched 01:24:01.521597 run osmo-stp_10.42.42.5(pid=8475): Launched 01:24:01.662922 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:24:02.329620 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8477): Launched 01:24:02.465666 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:24:02.738803 run patchelf(pid=8478): Launched 01:24:02.918683 run osmo-stp_10.42.42.5(pid=8475): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8475)] 01:24:03.053955 run osmo-stp_10.42.42.5(pid=8475): stdout: | (launched: 2022-12-10_01:24:01.464809) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:24:03.190611 run osmo-stp_10.42.42.5(pid=8475): stderr: | 20221210012401831 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012401831 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012401831 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012401832 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012401832 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012401832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012401832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:24:03.327313 run osmo-stp_10.42.42.5(pid=8475): stdout: | (launched: 2022-12-10_01:24:01.464809) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:24:03.458723 run osmo-stp_10.42.42.5(pid=8475): stderr: | 20221210012401831 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012401831 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012401831 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012401832 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012401832 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012401832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012401832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:24:03.614155 run patchelf(pid=8478): Terminating (SIGINT) 01:24:03.792753 run patchelf(pid=8478): Terminated: ok {rc=0} 01:24:03.921595 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8475): Process ended prematurely: osmo-stp_10.42.42.5(pid=8475) [trial-2367↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8475)] [trial-2367↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 01:24:03.931786 tst iperf3m4.py:8: Test FAILED (10.7 sec) 01:24:03.960606 run osmo-hlr_10.42.42.2(pid=8472): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8472)] 01:24:04.010475 run osmo-hlr_10.42.42.2(pid=8472): stdout: | (launched: 2022-12-10_01:24:00.452322) 01:24:04.062011 run osmo-hlr_10.42.42.2(pid=8472): stderr: | 20221210012400628 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012400628 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012400628 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012400628 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012400628 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012400628 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012400639 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012400647 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012400647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012400647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:24:04.113878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8461): Terminating (SIGTERM) 01:24:04.155255 run iperf3-srv_10.42.42.10(pid=8462): Terminating (SIGTERM) 01:24:04.196221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8463): Terminating (SIGTERM) 01:24:04.237401 run iperf3-srv_10.42.42.10(pid=8464): Terminating (SIGTERM) 01:24:04.278416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8465): Terminating (SIGTERM) 01:24:04.319669 run iperf3-srv_10.42.42.10(pid=8466): Terminating (SIGTERM) 01:24:04.360687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8467): Terminating (SIGTERM) 01:24:04.402474 run iperf3-srv_10.42.42.10(pid=8468): Terminating (SIGTERM) 01:24:04.443459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8471): Terminating (SIGTERM) 01:24:04.484470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8474): Terminating (SIGTERM) 01:24:04.525897 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8477): Terminating (SIGTERM) 01:24:04.567240 --- ParallelTerminationStrategy: PID 8461 died... 01:24:04.587050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8461): Terminated: ok {rc=0} 01:24:04.632705 --- ParallelTerminationStrategy: PID 8462 died... 01:24:04.651992 run iperf3-srv_10.42.42.10(pid=8462): Terminated {rc=256} 01:24:04.697305 --- ParallelTerminationStrategy: PID 8463 died... 01:24:04.716567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8463): Terminated: ok {rc=0} 01:24:04.762375 --- ParallelTerminationStrategy: PID 8464 died... 01:24:04.781567 run iperf3-srv_10.42.42.10(pid=8464): Terminated {rc=256} 01:24:04.827350 --- ParallelTerminationStrategy: PID 8465 died... 01:24:04.846770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8465): Terminated: ok {rc=0} 01:24:04.892385 --- ParallelTerminationStrategy: PID 8466 died... 01:24:04.911783 run iperf3-srv_10.42.42.10(pid=8466): Terminated {rc=256} 01:24:04.957236 --- ParallelTerminationStrategy: PID 8467 died... 01:24:04.976463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8467): Terminated: ok {rc=0} 01:24:05.022238 --- ParallelTerminationStrategy: PID 8468 died... 01:24:05.041547 run iperf3-srv_10.42.42.10(pid=8468): Terminated {rc=256} 01:24:05.086842 --- ParallelTerminationStrategy: PID 8471 died... 01:24:05.106324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8471): Terminated: ok {rc=0} 01:24:05.151757 --- ParallelTerminationStrategy: PID 8474 died... 01:24:05.171175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8474): Terminated: ok {rc=0} 01:24:05.216724 --- ParallelTerminationStrategy: PID 8477 died... 01:24:05.236242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8477): Terminated: ok {rc=0} 01:24:05.323078 bus /gobi_4: Setting Powered False 01:24:06.422463 bus /gobi_4: Setting Powered False 01:24:07.537573 bus /gobi_1: Setting Powered False 01:24:08.636422 bus /gobi_1: Setting Powered False 01:24:09.753243 bus /gobi_0: Setting Powered False 01:24:10.851647 bus /gobi_0: Setting Powered False 01:24:11.962103 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 01:24:13.064189 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:13.076779 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:24:13.130932 tst ping.py: using LAC 25013 01:24:13.257281 tst ping.py: using RAC 23 01:24:13.381649 tst ping.py: using CellId 25013 01:24:13.505193 tst ping.py: using BVCI 25014 01:24:13.620867 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:13.632706 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:13.644303 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:13.656030 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:13.667481 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:13.679027 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:13.690712 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:13.702306 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:24:13.819448 tst ping.py:19: start network... 01:24:14.031681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:24:14.519863 run create_hlr_db(pid=8479): Launched 01:24:14.648287 bus /gobi_6: Setting Powered False 01:24:15.710736 run create_hlr_db(pid=8479): Terminated: ok {rc=0} 01:24:16.175888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8481): Launched 01:24:16.492148 run osmo-hlr_10.42.42.2(pid=8482): Launched 01:24:16.636748 run osmo-stp_10.42.42.5: Starting osmo-stp 01:24:17.299772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8484): Launched 01:24:17.620805 run osmo-stp_10.42.42.5(pid=8485): Launched 01:24:17.734961 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:24:18.244879 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8487): Launched 01:24:18.359375 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:24:18.611064 run patchelf(pid=8488): Launched 01:24:18.776027 run osmo-stp_10.42.42.5(pid=8485): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8485)] 01:24:18.900855 run osmo-stp_10.42.42.5(pid=8485): stdout: | (launched: 2022-12-10_01:24:17.566082) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:24:19.027925 run osmo-stp_10.42.42.5(pid=8485): stderr: | 20221210012417735 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012417736 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012417736 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012417736 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012417739 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012417739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012417739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:24:19.154501 run osmo-stp_10.42.42.5(pid=8485): stdout: | (launched: 2022-12-10_01:24:17.566082) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:24:19.276180 run osmo-stp_10.42.42.5(pid=8485): stderr: | 20221210012417735 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012417736 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012417736 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012417736 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012417739 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012417739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012417739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:24:19.420004 run patchelf(pid=8488): Terminating (SIGINT) 01:24:19.585471 run patchelf(pid=8488): Terminated: ok {rc=0} 01:24:19.704357 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8485): Process ended prematurely: osmo-stp_10.42.42.5(pid=8485) [trial-2367↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8485)] [trial-2367↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 01:24:19.713341 tst ping.py:22: Test FAILED (6.6 sec) 01:24:19.740343 run osmo-hlr_10.42.42.2(pid=8482): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8482)] 01:24:19.787880 run osmo-hlr_10.42.42.2(pid=8482): stdout: | (launched: 2022-12-10_01:24:16.435121) 01:24:19.837335 run osmo-hlr_10.42.42.2(pid=8482): stderr: | 20221210012416841 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012416841 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012416841 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012416841 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012416841 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012416841 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012416858 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012416877 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012416878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012416878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:24:19.887391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8481): Terminating (SIGTERM) 01:24:19.927302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8484): Terminating (SIGTERM) 01:24:19.966954 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8487): Terminating (SIGTERM) 01:24:20.006953 --- ParallelTerminationStrategy: PID 8481 died... 01:24:20.025885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8481): Terminated: ok {rc=0} 01:24:20.070088 --- ParallelTerminationStrategy: PID 8484 died... 01:24:20.088533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8484): Terminated: ok {rc=0} 01:24:20.132273 --- ParallelTerminationStrategy: PID 8487 died... 01:24:20.150900 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8487): Terminated: ok {rc=0} 01:24:20.236558 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 01:24:21.325457 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:21.337977 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:24:21.395116 tst ping_idle_ping.py: using LAC 25014 01:24:21.525872 tst ping_idle_ping.py: using RAC 24 01:24:21.656180 tst ping_idle_ping.py: using CellId 25014 01:24:21.774601 tst ping_idle_ping.py: using BVCI 25015 01:24:21.881711 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:21.893162 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:21.904387 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:21.915906 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:21.927783 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:21.939318 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:21.950903 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:21.962259 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:24:22.078209 tst ping_idle_ping.py:24: start network... 01:24:22.275136 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:24:22.736045 run create_hlr_db(pid=8489): Launched 01:24:22.868290 bus /gobi_6: Setting Powered False 01:24:23.931373 run create_hlr_db(pid=8489): Terminated: ok {rc=0} 01:24:24.354416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8491): Launched 01:24:24.650304 run osmo-hlr_10.42.42.2(pid=8492): Launched 01:24:24.773401 run osmo-stp_10.42.42.5: Starting osmo-stp 01:24:25.322713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8494): Launched 01:24:25.640251 run osmo-stp_10.42.42.5(pid=8495): Launched 01:24:25.760842 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:24:26.306415 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8497): Launched 01:24:26.428798 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:24:26.695686 run patchelf(pid=8498): Launched 01:24:26.873061 run osmo-stp_10.42.42.5(pid=8495): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8495)] 01:24:27.007199 run osmo-stp_10.42.42.5(pid=8495): stdout: | (launched: 2022-12-10_01:24:25.582546) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:24:27.143245 run osmo-stp_10.42.42.5(pid=8495): stderr: | 20221210012425775 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012425775 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012425776 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012425776 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012425777 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012425777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012425777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:24:27.278773 run osmo-stp_10.42.42.5(pid=8495): stdout: | (launched: 2022-12-10_01:24:25.582546) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:24:27.409191 run osmo-stp_10.42.42.5(pid=8495): stderr: | 20221210012425775 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012425775 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012425776 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012425776 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012425777 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012425777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012425777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:24:27.563070 run patchelf(pid=8498): Terminating (SIGINT) 01:24:27.739254 run patchelf(pid=8498): Terminated: ok {rc=0} 01:24:27.866909 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8495): Process ended prematurely: osmo-stp_10.42.42.5(pid=8495) [trial-2367↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8495)] [trial-2367↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 01:24:27.876362 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 01:24:27.904389 run osmo-hlr_10.42.42.2(pid=8492): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8492)] 01:24:27.954068 run osmo-hlr_10.42.42.2(pid=8492): stdout: | (launched: 2022-12-10_01:24:24.595945) 01:24:28.005338 run osmo-hlr_10.42.42.2(pid=8492): stderr: | 20221210012424791 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012424791 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012424791 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012424791 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012424791 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012424791 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012424806 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012424815 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012424815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012424815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:24:28.057253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8491): Terminating (SIGTERM) 01:24:28.098943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8494): Terminating (SIGTERM) 01:24:28.140633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8497): Terminating (SIGTERM) 01:24:28.182783 --- ParallelTerminationStrategy: PID 8491 died... 01:24:28.202945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8491): Terminated: ok {rc=0} 01:24:28.249541 --- ParallelTerminationStrategy: PID 8494 died... 01:24:28.269547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8494): Terminated: ok {rc=0} 01:24:28.315601 --- ParallelTerminationStrategy: PID 8497 died... 01:24:28.335335 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8497): Terminated: ok {rc=0} 01:24:28.423395 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:24:29.737169 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:24:29.744835 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:24:29.778766 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 01:24:29.813834 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:24:29.867823 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:24:29.901142 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 01:24:29.936370 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:24:30.501980 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2367 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 01:24:30.508895 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:24:30.520616 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:24:30.590983 tst switch_tch_pdch.py: using LAC 25015 01:24:30.706855 tst switch_tch_pdch.py: using RAC 25 01:24:30.825722 tst switch_tch_pdch.py: using CellId 25015 01:24:30.963292 tst switch_tch_pdch.py: using BVCI 25016 01:24:31.076918 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:24:31.088694 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:24:31.100408 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:24:31.112705 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:24:31.125264 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:24:31.137414 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:24:31.150233 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:24:31.162917 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:24:31.279442 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:24:31.396341 tst switch_tch_pdch.py:51: start network... 01:24:31.617704 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:24:32.120397 run create_hlr_db(pid=8503): Launched 01:24:32.264823 bus /gobi_6: Setting Powered False 01:24:33.326960 run create_hlr_db(pid=8503): Terminated: ok {rc=0} 01:24:33.765837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8505): Launched 01:24:34.084718 run osmo-hlr_10.42.42.2(pid=8506): Launched 01:24:34.204711 run osmo-stp_10.42.42.5: Starting osmo-stp 01:24:34.750166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8508): Launched 01:24:35.066622 run osmo-stp_10.42.42.5(pid=8509): Launched 01:24:35.188572 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:24:35.731856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8511): Launched 01:24:35.853203 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:24:36.118492 run patchelf(pid=8512): Launched 01:24:36.295366 run osmo-stp_10.42.42.5(pid=8509): ERR: Terminated: ERROR {rc=1} [trial-2367↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8509)] 01:24:36.428407 run osmo-stp_10.42.42.5(pid=8509): stdout: | (launched: 2022-12-10_01:24:35.009126) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:24:36.563272 run osmo-stp_10.42.42.5(pid=8509): stderr: | 20221210012435199 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012435199 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012435199 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012435199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012435202 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012435202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012435202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:24:36.698233 run osmo-stp_10.42.42.5(pid=8509): stdout: | (launched: 2022-12-10_01:24:35.009126) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:24:36.828649 run osmo-stp_10.42.42.5(pid=8509): stderr: | 20221210012435199 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012435199 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012435199 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012435199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012435202 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012435202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012435202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:24:36.982292 run patchelf(pid=8512): Terminating (SIGINT) 01:24:37.158592 run patchelf(pid=8512): Terminated: ok {rc=0} 01:24:37.285041 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=8509): Process ended prematurely: osmo-stp_10.42.42.5(pid=8509) [trial-2367↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8509)] [trial-2367↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 01:24:37.294613 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 01:24:37.322562 run osmo-hlr_10.42.42.2(pid=8506): ERR: Terminated: ERROR {rc=237} [trial-2367↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8506)] 01:24:37.372402 run osmo-hlr_10.42.42.2(pid=8506): stdout: | (launched: 2022-12-10_01:24:34.026948) 01:24:37.423901 run osmo-hlr_10.42.42.2(pid=8506): stderr: | 20221210012434228 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012434228 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012434228 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012434228 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012434228 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012434228 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012434241 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012434250 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012434250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012434250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:24:37.475664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8505): Terminating (SIGTERM) 01:24:37.517215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8508): Terminating (SIGTERM) 01:24:37.558877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8511): Terminating (SIGTERM) 01:24:37.600486 --- ParallelTerminationStrategy: PID 8505 died... 01:24:37.620408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8505): Terminated: ok {rc=0} 01:24:37.666071 --- ParallelTerminationStrategy: PID 8508 died... 01:24:37.685314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8508): Terminated: ok {rc=0} 01:24:37.730956 --- ParallelTerminationStrategy: PID 8511 died... 01:24:37.750249 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8511): Terminated: ok {rc=0} 01:24:37.837689 bus /gobi_0: Setting Powered False 01:24:38.935789 bus /gobi_0: Setting Powered False 01:24:40.050258 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 01:24:41.308518 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:24:41.314827 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 01:24:41.347805 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 01:24:41.383054 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 01:24:41.435799 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 01:24:41.468660 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 01:24:41.503660 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 01:24:42.059044 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2367 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 01:24:42.064426 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:24:42.075323 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 01:24:42.142291 tst switch_tch_pdch.py: using LAC 25016 01:24:42.255117 tst switch_tch_pdch.py: using RAC 26 01:24:42.368239 tst switch_tch_pdch.py: using CellId 25016 01:24:42.481756 tst switch_tch_pdch.py: using BVCI 25017 01:24:42.590785 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:24:42.601723 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:24:42.612319 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:24:42.623270 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:24:42.634183 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:24:42.645079 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:24:42.656037 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:24:42.666908 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 01:24:42.778096 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 01:24:42.891852 tst switch_tch_pdch.py:51: start network... 01:24:43.087157 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:24:43.517456 run create_hlr_db(pid=8518): Launched 01:24:43.630267 bus /gobi_6: Setting Powered False 01:24:44.689095 run create_hlr_db(pid=8518): Terminated: ok {rc=0} 01:24:45.093406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8520): Launched 01:24:45.411084 run osmo-hlr_10.42.42.2(pid=8521): Launched 01:24:45.531507 run osmo-stp_10.42.42.5: Starting osmo-stp 01:24:46.069679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8523): Launched 01:24:46.389947 run osmo-stp_10.42.42.5(pid=8524): Launched 01:24:46.698646 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:24:47.251760 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8526): Launched 01:24:47.388363 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:24:47.656181 run patchelf(pid=8527): Launched 01:24:47.833462 run osmo-stp_10.42.42.5(pid=8524): ERR: Terminated: ERROR {rc=1} [trial-2367↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8524)] 01:24:47.966943 run osmo-stp_10.42.42.5(pid=8524): stdout: | (launched: 2022-12-10_01:24:46.332742) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:24:48.102109 run osmo-stp_10.42.42.5(pid=8524): stderr: | 20221210012446597 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012446597 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012446598 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012446598 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012446598 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012446599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012446599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:24:48.237157 run osmo-stp_10.42.42.5(pid=8524): stdout: | (launched: 2022-12-10_01:24:46.332742) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:24:48.366979 run osmo-stp_10.42.42.5(pid=8524): stderr: | 20221210012446597 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012446597 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012446598 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012446598 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012446598 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012446599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012446599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:24:48.520298 run patchelf(pid=8527): Terminating (SIGINT) 01:24:48.695659 run patchelf(pid=8527): Terminated: ok {rc=0} 01:24:48.822911 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=8524): Process ended prematurely: osmo-stp_10.42.42.5(pid=8524) [trial-2367↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8524)] [trial-2367↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 01:24:48.832440 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 01:24:48.860359 run osmo-hlr_10.42.42.2(pid=8521): ERR: Terminated: ERROR {rc=237} [trial-2367↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8521)] 01:24:48.910203 run osmo-hlr_10.42.42.2(pid=8521): stdout: | (launched: 2022-12-10_01:24:45.353746) 01:24:48.961654 run osmo-hlr_10.42.42.2(pid=8521): stderr: | 20221210012445551 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012445551 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012445551 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012445551 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012445551 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012445551 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012445564 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012445572 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012445572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012445572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:24:49.013709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8520): Terminating (SIGTERM) 01:24:49.055377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8523): Terminating (SIGTERM) 01:24:49.097233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8526): Terminating (SIGTERM) 01:24:49.139048 --- ParallelTerminationStrategy: PID 8520 died... 01:24:49.158865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8520): Terminated: ok {rc=0} 01:24:49.205416 --- ParallelTerminationStrategy: PID 8523 died... 01:24:49.224645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8523): Terminated: ok {rc=0} 01:24:49.270493 --- ParallelTerminationStrategy: PID 8526 died... 01:24:49.289939 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8526): Terminated: ok {rc=0} 01:24:49.376788 bus /gobi_0: Setting Powered False 01:24:50.475475 bus /gobi_0: Setting Powered False 01:24:51.591061 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 nitb_sms:trx-lms --------------------------------------------------------------------- 01:24:52.844395 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:24:52.848529 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 01:24:52.882423 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 01:24:52.889394 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 01:24:52.943244 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 01:24:52.976916 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 01:24:52.983981 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 01:24:53.518317 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 01:24:53.523736 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 01:24:53.534580 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 01:24:53.581796 tst mo_mt_sms.py: using LAC 25017 01:24:53.706729 tst mo_mt_sms.py: using RAC 27 01:24:53.830944 tst mo_mt_sms.py: using CellId 25017 01:24:53.954271 tst mo_mt_sms.py: using BVCI 25018 01:24:54.069135 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 01:24:54.183037 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 01:24:54.298038 tst mo_mt_sms.py:9: start nitb and bts... 01:24:54.510494 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:24:55.152280 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8532): Launched 01:24:55.468102 run osmo-nitb_10.42.42.2(pid=8533): Launched 01:24:55.643771 run osmo-nitb_10.42.42.2(pid=8533): ERR: Terminated: ERROR {rc=2} [trial-2367↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8533)] 01:24:55.784682 run osmo-nitb_10.42.42.2(pid=8533): stdout: | (launched: 2022-12-10_01:24:55.410704) 01:24:55.927247 run osmo-nitb_10.42.42.2(pid=8533): stderr: | (launched: 2022-12-10_01:24:55.457648) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:24:56.069257 run osmo-nitb_10.42.42.2(pid=8533): stdout: | (launched: 2022-12-10_01:24:55.410704) 01:24:56.206206 run osmo-nitb_10.42.42.2(pid=8533): stderr: | (launched: 2022-12-10_01:24:55.457648) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=8533): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8533) [trial-2367↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8533)] 01:24:56.588008 tst osmo-nitb_10.42.42.2(pid=8533): stdout: | (launched: 2022-12-10_01:24:55.410704) 01:24:56.716204 tst osmo-nitb_10.42.42.2(pid=8533): stderr: | (launched: 2022-12-10_01:24:55.457648) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:24:56.867345 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=8533): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8533) [trial-2367↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8533)] [trial-2367↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 01:24:56.876417 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 01:24:56.883507 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8532): Terminating (SIGTERM) 01:24:57.093578 --- ParallelTerminationStrategy: PID 8532 died... 01:24:57.115273 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8532): Terminated: ok {rc=0} 01:24:57.202476 bus /sierra_3: Setting Powered False 01:24:58.301861 bus /sierra_3: Setting Powered False 01:24:59.414788 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 sms:trx-lms --------------------------------------------------------------------- 01:25:00.616043 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:25:00.620295 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 01:25:00.654274 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 01:25:00.681420 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 01:25:00.735513 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 01:25:00.769340 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 01:25:00.796651 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 01:25:01.338441 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 01:25:01.345625 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:01.357277 tst sms:trx-lms: Using 1 x bts (candidates: 1) 01:25:01.411420 tst mo_mt_sms.py: using LAC 25018 01:25:01.535825 tst mo_mt_sms.py: using RAC 28 01:25:01.666462 tst mo_mt_sms.py: using CellId 25018 01:25:01.821110 tst mo_mt_sms.py: using BVCI 25019 01:25:01.946473 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:01.958592 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:01.970677 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:01.982292 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:01.994054 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:02.005658 tst sms:trx-lms: Using 1 x modem (candidates: 2) 01:25:02.125179 tst sms:trx-lms: Using 1 x modem (candidates: 2) 01:25:02.245351 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:25:02.708355 run create_hlr_db(pid=8540): Launched 01:25:02.826227 bus /sierra_2: Setting Powered False 01:25:03.885098 run create_hlr_db(pid=8540): Terminated: ok {rc=0} 01:25:04.316043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8542): Launched 01:25:04.632423 run osmo-hlr_10.42.42.2(pid=8543): Launched 01:25:04.753631 run osmo-stp_10.42.42.5: Starting osmo-stp 01:25:05.300413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8545): Launched 01:25:05.615196 run osmo-stp_10.42.42.5(pid=8546): Launched 01:25:05.738290 run osmo-msc_10.42.42.6: Starting osmo-msc 01:25:06.308478 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8548): Launched 01:25:06.623003 run osmo-msc_10.42.42.6(pid=8549): Launched 01:25:06.798982 run osmo-stp_10.42.42.5(pid=8546): ERR: Terminated: ERROR {rc=1} [trial-2367↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8546)] 01:25:06.931838 run osmo-stp_10.42.42.5(pid=8546): stdout: | (launched: 2022-12-10_01:25:05.557538) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:25:07.064794 run osmo-stp_10.42.42.5(pid=8546): stderr: | 20221210012505752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012505752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012505752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012505753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012505753 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012505753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012505753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:25:07.196840 run osmo-stp_10.42.42.5(pid=8546): stdout: | (launched: 2022-12-10_01:25:05.557538) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:25:07.322019 run osmo-stp_10.42.42.5(pid=8546): stderr: | 20221210012505752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012505752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012505752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012505753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012505753 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012505753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012505753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:25:07.471286 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=8546): Process ended prematurely: osmo-stp_10.42.42.5(pid=8546) [trial-2367↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8546)] [trial-2367↪sms:trx-lms↪mo_mt_sms.py:16] 01:25:07.480155 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 01:25:07.507293 run osmo-hlr_10.42.42.2(pid=8543): ERR: Terminated: ERROR {rc=237} [trial-2367↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8543)] 01:25:07.557108 run osmo-hlr_10.42.42.2(pid=8543): stdout: | (launched: 2022-12-10_01:25:04.574923) 01:25:07.608356 run osmo-hlr_10.42.42.2(pid=8543): stderr: | 20221210012504771 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012504771 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012504771 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012504771 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012504771 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012504771 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012504784 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012504792 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012504792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012504792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:25:07.679805 run osmo-msc_10.42.42.6(pid=8549): ERR: Terminated: ERROR {rc=2} [trial-2367↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8549)] 01:25:07.729179 run osmo-msc_10.42.42.6(pid=8549): stdout: | (launched: 2022-12-10_01:25:06.565239) 01:25:07.780158 run osmo-msc_10.42.42.6(pid=8549): stderr: | 20221210012506888 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210012506888 DLGLOBAL DEBUG validating counter group 0x7ff118846c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210012506888 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210012506888 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210012506888 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210012506888 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210012506890 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210012506890 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210012506891 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210012506891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:25:07.831959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8542): Terminating (SIGTERM) 01:25:07.873445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8545): Terminating (SIGTERM) 01:25:07.914796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8548): Terminating (SIGTERM) 01:25:07.956480 --- ParallelTerminationStrategy: PID 8542 died... 01:25:07.976097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8542): Terminated: ok {rc=0} 01:25:08.021734 --- ParallelTerminationStrategy: PID 8545 died... 01:25:08.040768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8545): Terminated: ok {rc=0} 01:25:08.086692 --- ParallelTerminationStrategy: PID 8548 died... 01:25:08.105912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8548): Terminated: ok {rc=0} 01:25:08.192914 bus /sierra_3: Setting Powered False 01:25:09.292238 bus /sierra_3: Setting Powered False 01:25:10.411011 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 nitb_ussd:trx-lms --------------------------------------------------------------------- 01:25:11.645281 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:25:11.649285 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 01:25:11.685773 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 01:25:11.692671 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 01:25:11.728414 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 01:25:11.762317 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 01:25:11.769349 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 01:25:12.287627 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2367 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 01:25:12.292800 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 01:25:12.303686 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 01:25:12.351993 tst assert_extension.py: using LAC 25019 01:25:12.470377 tst assert_extension.py: using RAC 29 01:25:12.595769 tst assert_extension.py: using CellId 25019 01:25:12.719014 tst assert_extension.py: using BVCI 25020 01:25:12.833382 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 01:25:12.946607 tst assert_extension.py:10: start nitb and bts... 01:25:13.143749 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:25:13.747590 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8554): Launched 01:25:14.043485 run osmo-nitb_10.42.42.2(pid=8555): Launched 01:25:14.208508 run osmo-nitb_10.42.42.2(pid=8555): ERR: Terminated: ERROR {rc=2} [trial-2367↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8555)] 01:25:14.341860 run osmo-nitb_10.42.42.2(pid=8555): stdout: | (launched: 2022-12-10_01:25:13.989321) 01:25:14.476465 run osmo-nitb_10.42.42.2(pid=8555): stderr: | (launched: 2022-12-10_01:25:14.033330) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:25:14.610864 run osmo-nitb_10.42.42.2(pid=8555): stdout: | (launched: 2022-12-10_01:25:13.989321) 01:25:14.739927 run osmo-nitb_10.42.42.2(pid=8555): stderr: | (launched: 2022-12-10_01:25:14.033330) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=8555): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8555) [trial-2367↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8555)] 01:25:15.156062 tst osmo-nitb_10.42.42.2(pid=8555): stdout: | (launched: 2022-12-10_01:25:13.989321) 01:25:15.275567 tst osmo-nitb_10.42.42.2(pid=8555): stderr: | (launched: 2022-12-10_01:25:14.033330) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:25:15.416909 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=8555): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8555) [trial-2367↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8555)] [trial-2367↪nitb_ussd:trx-lms↪assert_extension.py:12] 01:25:15.425661 tst assert_extension.py:12: Test FAILED (3.1 sec) 01:25:15.432499 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8554): Terminating (SIGTERM) 01:25:15.641737 --- ParallelTerminationStrategy: PID 8554 died... 01:25:15.662900 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8554): Terminated: ok {rc=0} 01:25:15.749115 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 ussd:trx-lms --------------------------------------------------------------------- 01:25:16.927321 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:25:16.931285 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 01:25:16.968569 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 01:25:16.997322 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 01:25:17.031956 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 01:25:17.069315 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 01:25:17.097813 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 01:25:17.623105 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2367 ussd:trx-lms assert_extension.py ---------------------------------------------- 01:25:17.628481 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:17.639538 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 01:25:17.693535 tst assert_extension.py: using LAC 25020 01:25:17.815674 tst assert_extension.py: using RAC 30 01:25:17.939171 tst assert_extension.py: using CellId 25020 01:25:18.060270 tst assert_extension.py: using BVCI 25021 01:25:18.174024 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:18.184851 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:18.195651 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:18.206458 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:18.217305 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:18.227949 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 01:25:18.341320 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:25:18.798762 run create_hlr_db(pid=8559): Launched 01:25:18.914040 bus /sierra_2: Setting Powered False 01:25:19.972755 run create_hlr_db(pid=8559): Terminated: ok {rc=0} 01:25:20.405317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8561): Launched 01:25:20.722088 run osmo-hlr_10.42.42.2(pid=8562): Launched 01:25:20.845593 run osmo-stp_10.42.42.5: Starting osmo-stp 01:25:21.390609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8564): Launched 01:25:21.707654 run osmo-stp_10.42.42.5(pid=8565): Launched 01:25:21.829300 run osmo-msc_10.42.42.6: Starting osmo-msc 01:25:22.400881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8567): Launched 01:25:22.716606 run osmo-msc_10.42.42.6(pid=8568): Launched 01:25:22.895493 run osmo-stp_10.42.42.5(pid=8565): ERR: Terminated: ERROR {rc=1} [trial-2367↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8565)] 01:25:23.028482 run osmo-stp_10.42.42.5(pid=8565): stdout: | (launched: 2022-12-10_01:25:21.649402) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:25:23.161973 run osmo-stp_10.42.42.5(pid=8565): stderr: | 20221210012521841 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012521841 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012521841 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012521842 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012521842 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012521842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012521842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:25:23.294348 run osmo-stp_10.42.42.5(pid=8565): stdout: | (launched: 2022-12-10_01:25:21.649402) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:25:23.420157 run osmo-stp_10.42.42.5(pid=8565): stderr: | 20221210012521841 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012521841 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012521841 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012521842 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012521842 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012521842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012521842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:25:23.571036 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=8565): Process ended prematurely: osmo-stp_10.42.42.5(pid=8565) [trial-2367↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8565)] [trial-2367↪ussd:trx-lms↪assert_extension.py:17] 01:25:23.579966 tst assert_extension.py:17: Test FAILED (5.9 sec) 01:25:23.607434 run osmo-hlr_10.42.42.2(pid=8562): ERR: Terminated: ERROR {rc=237} [trial-2367↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8562)] 01:25:23.657413 run osmo-hlr_10.42.42.2(pid=8562): stdout: | (launched: 2022-12-10_01:25:20.664531) 01:25:23.709357 run osmo-hlr_10.42.42.2(pid=8562): stderr: | 20221210012520861 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012520861 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012520861 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012520861 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012520861 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012520861 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012520874 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012520882 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012520882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012520882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:25:23.781581 run osmo-msc_10.42.42.6(pid=8568): ERR: Terminated: ERROR {rc=2} [trial-2367↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8568)] 01:25:23.831766 run osmo-msc_10.42.42.6(pid=8568): stdout: | (launched: 2022-12-10_01:25:22.658981) 01:25:23.883310 run osmo-msc_10.42.42.6(pid=8568): stderr: | 20221210012522978 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210012522978 DLGLOBAL DEBUG validating counter group 0x7f8c8bf93c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210012522978 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210012522978 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210012522978 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210012522979 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210012522980 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210012522981 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210012522981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210012522981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:25:23.935268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8561): Terminating (SIGTERM) 01:25:23.976684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8564): Terminating (SIGTERM) 01:25:24.018522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8567): Terminating (SIGTERM) 01:25:24.060568 --- ParallelTerminationStrategy: PID 8561 died... 01:25:24.080263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8561): Terminated: ok {rc=0} 01:25:24.126701 --- ParallelTerminationStrategy: PID 8564 died... 01:25:24.146195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8564): Terminated: ok {rc=0} 01:25:24.192192 --- ParallelTerminationStrategy: PID 8567 died... 01:25:24.211840 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8567): Terminated: ok {rc=0} 01:25:24.298913 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 01:25:25.516335 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:25:25.523350 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 01:25:25.557326 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 01:25:25.584484 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 01:25:25.637009 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 01:25:25.670993 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 01:25:25.698469 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 01:25:26.250395 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 01:25:26.302460 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:25:26.313981 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:25:26.384612 tst mo_mt_call.py: using LAC 25021 01:25:26.510646 tst mo_mt_call.py: using RAC 31 01:25:26.636066 tst mo_mt_call.py: using CellId 25021 01:25:26.761561 tst mo_mt_call.py: using BVCI 25022 01:25:26.878965 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:25:26.890508 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:25:26.901925 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:25:26.913256 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:25:26.924604 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:25:26.935927 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:25:27.056380 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:25:27.174794 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:25:27.672236 run create_hlr_db(pid=8573): Launched 01:25:27.804089 bus /sierra_2: Setting Powered False 01:25:28.867225 run create_hlr_db(pid=8573): Terminated: ok {rc=0} 01:25:29.295227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8575): Launched 01:25:29.596678 run osmo-hlr_10.42.42.2(pid=8576): Launched 01:25:29.711890 run osmo-stp_10.42.42.5: Starting osmo-stp 01:25:30.246681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8578): Launched 01:25:30.547875 run osmo-stp_10.42.42.5(pid=8579): Launched 01:25:30.663429 run osmo-msc_10.42.42.6: Starting osmo-msc 01:25:31.245844 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8581): Launched 01:25:31.599546 run osmo-msc_10.42.42.6(pid=8582): Launched 01:25:31.882375 run osmo-stp_10.42.42.5(pid=8579): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8579)] 01:25:32.050357 run osmo-stp_10.42.42.5(pid=8579): stdout: | (launched: 2022-12-10_01:25:30.492363) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:25:32.183940 run osmo-stp_10.42.42.5(pid=8579): stderr: | 20221210012530664 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012530664 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012530665 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012530665 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012530666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012530666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012530666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:25:32.335175 run osmo-stp_10.42.42.5(pid=8579): stdout: | (launched: 2022-12-10_01:25:30.492363) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:25:32.463440 run osmo-stp_10.42.42.5(pid=8579): stderr: | 20221210012530664 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012530664 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012530665 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012530665 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012530666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012530666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012530666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:25:32.610224 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8579): Process ended prematurely: osmo-stp_10.42.42.5(pid=8579) [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8579)] [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 01:25:32.619436 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 01:25:32.646752 run osmo-hlr_10.42.42.2(pid=8576): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8576)] 01:25:32.694862 run osmo-hlr_10.42.42.2(pid=8576): stdout: | (launched: 2022-12-10_01:25:29.541660) 01:25:32.744783 run osmo-hlr_10.42.42.2(pid=8576): stderr: | 20221210012529719 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012529719 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012529719 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012529719 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012529719 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012529719 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012529731 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012529739 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012529740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012529740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:25:32.814456 run osmo-msc_10.42.42.6(pid=8582): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8582)] 01:25:32.862559 run osmo-msc_10.42.42.6(pid=8582): stdout: | (launched: 2022-12-10_01:25:31.539208) 01:25:32.912112 run osmo-msc_10.42.42.6(pid=8582): stderr: | 20221210012532160 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210012532160 DLGLOBAL DEBUG validating counter group 0x7fe1a8787c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210012532160 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210012532160 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210012532169 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210012532170 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210012532171 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210012532172 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210012532172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210012532172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:25:32.962183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8575): Terminating (SIGTERM) 01:25:33.002329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8578): Terminating (SIGTERM) 01:25:33.042506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8581): Terminating (SIGTERM) 01:25:33.082864 --- ParallelTerminationStrategy: PID 8575 died... 01:25:33.102203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8575): Terminated: ok {rc=0} 01:25:33.147059 --- ParallelTerminationStrategy: PID 8578 died... 01:25:33.165611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8578): Terminated: ok {rc=0} 01:25:33.209891 --- ParallelTerminationStrategy: PID 8581 died... 01:25:33.228683 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8581): Terminated: ok {rc=0} 01:25:33.313152 bus /sierra_3: Setting Powered False 01:25:34.411542 bus /sierra_3: Setting Powered False 01:25:35.530460 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 01:25:36.676781 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:25:36.688541 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:25:36.761245 tst mo_mt_call_osmux.py: using LAC 25022 01:25:36.878600 tst mo_mt_call_osmux.py: using RAC 32 01:25:36.994346 tst mo_mt_call_osmux.py: using CellId 25022 01:25:37.112530 tst mo_mt_call_osmux.py: using BVCI 25023 01:25:37.221235 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:25:37.232254 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:25:37.243076 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:25:37.254310 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:25:37.265517 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:25:37.276413 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:25:37.390493 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:25:37.512211 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:25:38.016011 run create_hlr_db(pid=8584): Launched 01:25:38.147701 bus /sierra_2: Setting Powered False 01:25:39.208252 run create_hlr_db(pid=8584): Terminated: ok {rc=0} 01:25:39.653546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8587): Launched 01:25:39.963101 run osmo-hlr_10.42.42.2(pid=8588): Launched 01:25:40.078246 run osmo-stp_10.42.42.5: Starting osmo-stp 01:25:40.598983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8590): Launched 01:25:40.901420 run osmo-stp_10.42.42.5(pid=8591): Launched 01:25:41.017133 run osmo-msc_10.42.42.6: Starting osmo-msc 01:25:41.564509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8593): Launched 01:25:41.868258 run osmo-msc_10.42.42.6(pid=8594): Launched 01:25:42.038043 run osmo-stp_10.42.42.5(pid=8591): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8591)] 01:25:42.166920 run osmo-stp_10.42.42.5(pid=8591): stdout: | (launched: 2022-12-10_01:25:40.846004) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:25:42.295100 run osmo-stp_10.42.42.5(pid=8591): stderr: | 20221210012541015 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012541015 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012541015 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012541016 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012541016 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012541016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012541017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:25:42.420926 run osmo-stp_10.42.42.5(pid=8591): stdout: | (launched: 2022-12-10_01:25:40.846004) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:25:42.541212 run osmo-stp_10.42.42.5(pid=8591): stderr: | 20221210012541015 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012541015 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012541015 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012541016 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012541016 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012541016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012541017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:25:42.685255 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8591): Process ended prematurely: osmo-stp_10.42.42.5(pid=8591) [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8591)] [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 01:25:42.694251 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 01:25:42.721424 run osmo-hlr_10.42.42.2(pid=8588): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8588)] 01:25:42.769413 run osmo-hlr_10.42.42.2(pid=8588): stdout: | (launched: 2022-12-10_01:25:39.907375) 01:25:42.819222 run osmo-hlr_10.42.42.2(pid=8588): stderr: | 20221210012540084 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012540084 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012540084 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012540084 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012540084 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012540084 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012540095 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012540104 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012540105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012540105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:25:42.888762 run osmo-msc_10.42.42.6(pid=8594): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8594)] 01:25:42.936782 run osmo-msc_10.42.42.6(pid=8594): stdout: | (launched: 2022-12-10_01:25:41.812384) 01:25:42.986168 run osmo-msc_10.42.42.6(pid=8594): stderr: | 20221210012542083 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210012542083 DLGLOBAL DEBUG validating counter group 0x7f8d98c8bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210012542083 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210012542084 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210012542084 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210012542084 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210012542087 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210012542088 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210012542088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210012542088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:25:43.035913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8587): Terminating (SIGTERM) 01:25:43.075839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8590): Terminating (SIGTERM) 01:25:43.115897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8593): Terminating (SIGTERM) 01:25:43.156087 --- ParallelTerminationStrategy: PID 8587 died... 01:25:43.175269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8587): Terminated: ok {rc=0} 01:25:43.219477 --- ParallelTerminationStrategy: PID 8590 died... 01:25:43.237930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8590): Terminated: ok {rc=0} 01:25:43.281959 --- ParallelTerminationStrategy: PID 8593 died... 01:25:43.300522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8593): Terminated: ok {rc=0} 01:25:43.384751 bus /sierra_3: Setting Powered False 01:25:44.482001 bus /sierra_3: Setting Powered False 01:25:45.597327 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 01:25:46.891707 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:25:46.900719 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 01:25:46.945697 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 01:25:46.981917 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 01:25:47.049193 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 01:25:47.103230 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 01:25:47.139270 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 01:25:47.657957 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 01:25:47.709594 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:25:47.720521 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:25:47.792788 tst mo_mt_call.py: using LAC 25023 01:25:47.909973 tst mo_mt_call.py: using RAC 33 01:25:48.028389 tst mo_mt_call.py: using CellId 25023 01:25:48.143895 tst mo_mt_call.py: using BVCI 25024 01:25:48.252381 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:25:48.263451 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:25:48.274483 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:25:48.285531 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:25:48.296588 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:25:48.307632 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:25:48.425755 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:25:48.541949 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:25:49.008671 run create_hlr_db(pid=8599): Launched 01:25:49.123892 bus /sierra_2: Setting Powered False 01:25:50.187669 run create_hlr_db(pid=8599): Terminated: ok {rc=0} 01:25:50.618305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8601): Launched 01:25:50.919966 run osmo-hlr_10.42.42.2(pid=8602): Launched 01:25:51.035425 run osmo-stp_10.42.42.5: Starting osmo-stp 01:25:51.569605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8604): Launched 01:25:51.872227 run osmo-stp_10.42.42.5(pid=8605): Launched 01:25:51.987676 run osmo-msc_10.42.42.6: Starting osmo-msc 01:25:52.533297 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8607): Launched 01:25:52.834706 run osmo-msc_10.42.42.6(pid=8608): Launched 01:25:53.004398 run osmo-stp_10.42.42.5(pid=8605): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8605)] 01:25:53.132176 run osmo-stp_10.42.42.5(pid=8605): stdout: | (launched: 2022-12-10_01:25:51.815967) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:25:53.259197 run osmo-stp_10.42.42.5(pid=8605): stderr: | 20221210012551986 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012551986 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012551987 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012551987 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012551987 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012551988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012551988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:25:53.383840 run osmo-stp_10.42.42.5(pid=8605): stdout: | (launched: 2022-12-10_01:25:51.815967) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:25:53.503263 run osmo-stp_10.42.42.5(pid=8605): stderr: | 20221210012551986 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012551986 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012551987 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012551987 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012551987 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012551988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012551988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:25:53.646570 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8605): Process ended prematurely: osmo-stp_10.42.42.5(pid=8605) [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8605)] [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 01:25:53.655409 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 01:25:53.682394 run osmo-hlr_10.42.42.2(pid=8602): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8602)] 01:25:53.730298 run osmo-hlr_10.42.42.2(pid=8602): stdout: | (launched: 2022-12-10_01:25:50.864636) 01:25:53.779238 run osmo-hlr_10.42.42.2(pid=8602): stderr: | 20221210012551042 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012551042 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012551042 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012551042 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012551042 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012551042 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012551060 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012551070 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012551070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012551070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:25:53.847926 run osmo-msc_10.42.42.6(pid=8608): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8608)] 01:25:53.895243 run osmo-msc_10.42.42.6(pid=8608): stdout: | (launched: 2022-12-10_01:25:52.778628) 01:25:53.944281 run osmo-msc_10.42.42.6(pid=8608): stderr: | 20221210012553049 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210012553049 DLGLOBAL DEBUG validating counter group 0x7fca0eb20c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210012553049 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210012553049 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210012553049 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210012553049 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210012553051 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210012553052 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210012553052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210012553052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:25:53.993545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8601): Terminating (SIGTERM) 01:25:54.033188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8604): Terminating (SIGTERM) 01:25:54.072727 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8607): Terminating (SIGTERM) 01:25:54.112578 --- ParallelTerminationStrategy: PID 8601 died... 01:25:54.131444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8601): Terminated: ok {rc=0} 01:25:54.175221 --- ParallelTerminationStrategy: PID 8604 died... 01:25:54.193556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8604): Terminated: ok {rc=0} 01:25:54.237834 --- ParallelTerminationStrategy: PID 8607 died... 01:25:54.256297 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8607): Terminated: ok {rc=0} 01:25:54.342369 bus /sierra_3: Setting Powered False 01:25:55.442492 bus /sierra_3: Setting Powered False 01:25:56.557993 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 01:25:57.701946 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:25:57.714019 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:25:57.782845 tst mo_mt_call_osmux.py: using LAC 25024 01:25:57.901178 tst mo_mt_call_osmux.py: using RAC 34 01:25:58.027853 tst mo_mt_call_osmux.py: using CellId 25024 01:25:58.154492 tst mo_mt_call_osmux.py: using BVCI 25025 01:25:58.273728 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:25:58.285460 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:25:58.296846 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:25:58.308554 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:25:58.320554 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:25:58.332149 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:25:58.453469 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:25:58.570611 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:25:59.039439 run create_hlr_db(pid=8610): Launched 01:25:59.155848 bus /sierra_2: Setting Powered False 01:26:00.216524 run create_hlr_db(pid=8610): Terminated: ok {rc=0} 01:26:00.655770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8612): Launched 01:26:01.006037 run osmo-hlr_10.42.42.2(pid=8613): Launched 01:26:01.171192 run osmo-stp_10.42.42.5: Starting osmo-stp 01:26:01.912021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8615): Launched 01:26:02.253749 run osmo-stp_10.42.42.5(pid=8616): Launched 01:26:02.392531 run osmo-msc_10.42.42.6: Starting osmo-msc 01:26:02.975291 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8618): Launched 01:26:03.298768 run osmo-msc_10.42.42.6(pid=8619): Launched 01:26:03.479992 run osmo-stp_10.42.42.5(pid=8616): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8616)] 01:26:03.614650 run osmo-stp_10.42.42.5(pid=8616): stdout: | (launched: 2022-12-10_01:26:02.192224) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:03.749540 run osmo-stp_10.42.42.5(pid=8616): stderr: | 20221210012602401 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012602401 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012602402 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012602402 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012602404 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012602405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012602405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:03.884807 run osmo-stp_10.42.42.5(pid=8616): stdout: | (launched: 2022-12-10_01:26:02.192224) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:04.012912 run osmo-stp_10.42.42.5(pid=8616): stderr: | 20221210012602401 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012602401 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012602402 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012602402 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012602404 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012602405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012602405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:04.165967 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8616): Process ended prematurely: osmo-stp_10.42.42.5(pid=8616) [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8616)] [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 01:26:04.175703 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 01:26:04.204069 run osmo-hlr_10.42.42.2(pid=8613): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8613)] 01:26:04.254147 run osmo-hlr_10.42.42.2(pid=8613): stdout: | (launched: 2022-12-10_01:26:00.947241) 01:26:04.306007 run osmo-hlr_10.42.42.2(pid=8613): stderr: | 20221210012601363 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012601363 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012601363 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012601363 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012601363 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012601363 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012601389 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012601406 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012601406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012601406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:26:04.377969 run osmo-msc_10.42.42.6(pid=8619): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8619)] 01:26:04.427639 run osmo-msc_10.42.42.6(pid=8619): stdout: | (launched: 2022-12-10_01:26:03.240279) 01:26:04.479325 run osmo-msc_10.42.42.6(pid=8619): stderr: | 20221210012603564 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210012603564 DLGLOBAL DEBUG validating counter group 0x7f5d1e589c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210012603564 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210012603564 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210012603564 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210012603565 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210012603566 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210012603567 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210012603567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210012603567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:26:04.530981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8612): Terminating (SIGTERM) 01:26:04.572491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8615): Terminating (SIGTERM) 01:26:04.614137 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8618): Terminating (SIGTERM) 01:26:04.656066 --- ParallelTerminationStrategy: PID 8612 died... 01:26:04.676034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8612): Terminated: ok {rc=0} 01:26:04.722374 --- ParallelTerminationStrategy: PID 8615 died... 01:26:04.741930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8615): Terminated: ok {rc=0} 01:26:04.787493 --- ParallelTerminationStrategy: PID 8618 died... 01:26:04.806843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8618): Terminated: ok {rc=0} 01:26:04.894845 bus /sierra_3: Setting Powered False 01:26:05.993147 bus /sierra_3: Setting Powered False 01:26:07.108535 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 01:26:08.360348 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:26:08.367416 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 01:26:08.401020 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 01:26:08.429518 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 01:26:08.480636 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 01:26:08.514373 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 01:26:08.541855 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 01:26:09.095106 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 01:26:09.146763 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:26:09.158493 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:26:09.228905 tst mo_mt_call.py: using LAC 25025 01:26:09.354316 tst mo_mt_call.py: using RAC 35 01:26:09.479634 tst mo_mt_call.py: using CellId 25025 01:26:09.605824 tst mo_mt_call.py: using BVCI 25026 01:26:09.721959 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:26:09.733536 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:26:09.744744 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:26:09.756044 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:26:09.767431 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:26:09.778757 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:26:09.894433 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:26:10.011301 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:26:10.478405 run create_hlr_db(pid=8624): Launched 01:26:10.597310 bus /sierra_2: Setting Powered False 01:26:11.657343 run create_hlr_db(pid=8624): Terminated: ok {rc=0} 01:26:12.097240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8626): Launched 01:26:12.420194 run osmo-hlr_10.42.42.2(pid=8627): Launched 01:26:12.544516 run osmo-stp_10.42.42.5: Starting osmo-stp 01:26:13.106626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8629): Launched 01:26:13.429657 run osmo-stp_10.42.42.5(pid=8630): Launched 01:26:13.554872 run osmo-msc_10.42.42.6: Starting osmo-msc 01:26:14.143520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8632): Launched 01:26:14.465140 run osmo-msc_10.42.42.6(pid=8633): Launched 01:26:14.645250 run osmo-stp_10.42.42.5(pid=8630): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8630)] 01:26:14.781891 run osmo-stp_10.42.42.5(pid=8630): stdout: | (launched: 2022-12-10_01:26:13.371349) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:14.919477 run osmo-stp_10.42.42.5(pid=8630): stderr: | 20221210012613567 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012613567 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012613567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012613568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012613568 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012613568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012613568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:15.054149 run osmo-stp_10.42.42.5(pid=8630): stdout: | (launched: 2022-12-10_01:26:13.371349) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:15.182548 run osmo-stp_10.42.42.5(pid=8630): stderr: | 20221210012613567 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012613567 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012613567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012613568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012613568 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012613568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012613568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:15.336038 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8630): Process ended prematurely: osmo-stp_10.42.42.5(pid=8630) [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8630)] [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 01:26:15.345494 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 01:26:15.373582 run osmo-hlr_10.42.42.2(pid=8627): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8627)] 01:26:15.423624 run osmo-hlr_10.42.42.2(pid=8627): stdout: | (launched: 2022-12-10_01:26:12.361656) 01:26:15.475405 run osmo-hlr_10.42.42.2(pid=8627): stderr: | 20221210012612562 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012612562 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012612562 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012612562 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012612562 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012612562 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012612575 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012612586 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012612586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012612586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:26:15.547460 run osmo-msc_10.42.42.6(pid=8633): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8633)] 01:26:15.597370 run osmo-msc_10.42.42.6(pid=8633): stdout: | (launched: 2022-12-10_01:26:14.406480) 01:26:15.649107 run osmo-msc_10.42.42.6(pid=8633): stderr: | 20221210012614729 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210012614729 DLGLOBAL DEBUG validating counter group 0x7f48d2c6ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210012614729 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210012614729 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210012614730 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210012614730 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210012614731 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210012614732 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210012614732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210012614732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:26:15.701194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8626): Terminating (SIGTERM) 01:26:15.742707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8629): Terminating (SIGTERM) 01:26:15.784534 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8632): Terminating (SIGTERM) 01:26:15.827097 --- ParallelTerminationStrategy: PID 8626 died... 01:26:15.869955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8626): Terminated: ok {rc=0} 01:26:15.923945 --- ParallelTerminationStrategy: PID 8629 died... 01:26:15.943409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8629): Terminated: ok {rc=0} 01:26:15.990697 --- ParallelTerminationStrategy: PID 8632 died... 01:26:16.010266 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8632): Terminated: ok {rc=0} 01:26:16.100430 bus /sierra_3: Setting Powered False 01:26:17.202942 bus /sierra_3: Setting Powered False 01:26:18.319397 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 01:26:19.465478 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:26:19.477377 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:26:19.550043 tst mo_mt_call_osmux.py: using LAC 25026 01:26:19.666539 tst mo_mt_call_osmux.py: using RAC 36 01:26:19.782535 tst mo_mt_call_osmux.py: using CellId 25026 01:26:19.900295 tst mo_mt_call_osmux.py: using BVCI 25027 01:26:20.009159 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:26:20.020428 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:26:20.031302 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:26:20.042224 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:26:20.053514 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:26:20.064353 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:26:20.178961 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:26:20.298295 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:26:20.798756 run create_hlr_db(pid=8635): Launched 01:26:20.932479 bus /sierra_2: Setting Powered False 01:26:21.995494 run create_hlr_db(pid=8635): Terminated: ok {rc=0} 01:26:22.425476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8637): Launched 01:26:22.729308 run osmo-hlr_10.42.42.2(pid=8638): Launched 01:26:22.845195 run osmo-stp_10.42.42.5: Starting osmo-stp 01:26:23.380782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8640): Launched 01:26:23.682163 run osmo-stp_10.42.42.5(pid=8641): Launched 01:26:23.800872 run osmo-msc_10.42.42.6: Starting osmo-msc 01:26:24.346551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8643): Launched 01:26:24.651284 run osmo-msc_10.42.42.6(pid=8644): Launched 01:26:24.821229 run osmo-stp_10.42.42.5(pid=8641): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8641)] 01:26:24.949126 run osmo-stp_10.42.42.5(pid=8641): stdout: | (launched: 2022-12-10_01:26:23.626957) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:25.076342 run osmo-stp_10.42.42.5(pid=8641): stderr: | 20221210012623799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012623799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012623799 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012623799 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012623800 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012623800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012623800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:25.201564 run osmo-stp_10.42.42.5(pid=8641): stdout: | (launched: 2022-12-10_01:26:23.626957) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:25.321999 run osmo-stp_10.42.42.5(pid=8641): stderr: | 20221210012623799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012623799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012623799 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012623799 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012623800 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012623800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012623800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:25.465908 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8641): Process ended prematurely: osmo-stp_10.42.42.5(pid=8641) [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8641)] [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 01:26:25.474893 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 01:26:25.501886 run osmo-hlr_10.42.42.2(pid=8638): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8638)] 01:26:25.550037 run osmo-hlr_10.42.42.2(pid=8638): stdout: | (launched: 2022-12-10_01:26:22.673700) 01:26:25.599480 run osmo-hlr_10.42.42.2(pid=8638): stderr: | 20221210012622851 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012622851 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012622851 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012622851 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012622851 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012622851 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012622863 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012622873 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012622873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012622873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:26:25.668261 run osmo-msc_10.42.42.6(pid=8644): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8644)] 01:26:25.715773 run osmo-msc_10.42.42.6(pid=8644): stdout: | (launched: 2022-12-10_01:26:24.595325) 01:26:25.764801 run osmo-msc_10.42.42.6(pid=8644): stderr: | 20221210012624867 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210012624867 DLGLOBAL DEBUG validating counter group 0x7ff31f4f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210012624868 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210012624868 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210012624868 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210012624868 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210012624870 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210012624870 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210012624870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210012624870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:26:25.814651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8637): Terminating (SIGTERM) 01:26:25.854087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8640): Terminating (SIGTERM) 01:26:25.893930 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8643): Terminating (SIGTERM) 01:26:25.933972 --- ParallelTerminationStrategy: PID 8637 died... 01:26:25.953105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8637): Terminated: ok {rc=0} 01:26:25.997341 --- ParallelTerminationStrategy: PID 8640 died... 01:26:26.015675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8640): Terminated: ok {rc=0} 01:26:26.059644 --- ParallelTerminationStrategy: PID 8643 died... 01:26:26.078207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8643): Terminated: ok {rc=0} 01:26:26.163726 bus /sierra_3: Setting Powered False 01:26:27.266706 bus /sierra_3: Setting Powered False 01:26:28.382090 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 01:26:29.634397 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:26:29.641416 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 01:26:29.675152 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 01:26:29.702192 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 01:26:29.755805 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 01:26:29.789708 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 01:26:29.816841 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 01:26:30.367501 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 01:26:30.418576 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:26:30.430042 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 01:26:30.500564 tst mo_mt_call.py: using LAC 25027 01:26:30.626374 tst mo_mt_call.py: using RAC 37 01:26:30.752630 tst mo_mt_call.py: using CellId 25027 01:26:30.885326 tst mo_mt_call.py: using BVCI 25028 01:26:31.010688 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:26:31.022697 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:26:31.034490 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:26:31.046387 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:26:31.059862 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:26:31.071705 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:26:31.193914 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:26:31.340175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:26:31.929799 run create_hlr_db(pid=8649): Launched 01:26:32.095878 bus /sierra_2: Setting Powered False 01:26:33.159495 run create_hlr_db(pid=8649): Terminated: ok {rc=0} 01:26:33.604941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8651): Launched 01:26:33.927439 run osmo-hlr_10.42.42.2(pid=8652): Launched 01:26:34.052657 run osmo-stp_10.42.42.5: Starting osmo-stp 01:26:34.604117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8654): Launched 01:26:34.925243 run osmo-stp_10.42.42.5(pid=8655): Launched 01:26:35.048863 run osmo-msc_10.42.42.6: Starting osmo-msc 01:26:35.630643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8657): Launched 01:26:35.954088 run osmo-msc_10.42.42.6(pid=8658): Launched 01:26:36.135993 run osmo-stp_10.42.42.5(pid=8655): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8655)] 01:26:36.271388 run osmo-stp_10.42.42.5(pid=8655): stdout: | (launched: 2022-12-10_01:26:34.866603) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:36.406392 run osmo-stp_10.42.42.5(pid=8655): stderr: | 20221210012635059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012635059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012635059 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012635060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012635060 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012635060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012635060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:36.540217 run osmo-stp_10.42.42.5(pid=8655): stdout: | (launched: 2022-12-10_01:26:34.866603) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:36.667930 run osmo-stp_10.42.42.5(pid=8655): stderr: | 20221210012635059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012635059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012635059 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012635060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012635060 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012635060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012635060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:36.820807 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8655): Process ended prematurely: osmo-stp_10.42.42.5(pid=8655) [trial-2367↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8655)] [trial-2367↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 01:26:36.830768 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 01:26:36.858802 run osmo-hlr_10.42.42.2(pid=8652): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8652)] 01:26:36.908926 run osmo-hlr_10.42.42.2(pid=8652): stdout: | (launched: 2022-12-10_01:26:33.868878) 01:26:36.960497 run osmo-hlr_10.42.42.2(pid=8652): stderr: | 20221210012634070 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012634070 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012634070 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012634070 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012634070 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012634070 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012634081 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012634089 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012634089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012634090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:26:37.032229 run osmo-msc_10.42.42.6(pid=8658): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8658)] 01:26:37.081988 run osmo-msc_10.42.42.6(pid=8658): stdout: | (launched: 2022-12-10_01:26:35.895480) 01:26:37.133455 run osmo-msc_10.42.42.6(pid=8658): stderr: | 20221210012636218 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210012636218 DLGLOBAL DEBUG validating counter group 0x7fe52a983c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210012636218 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210012636218 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210012636219 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210012636219 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210012636220 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210012636221 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210012636221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210012636221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:26:37.185407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8651): Terminating (SIGTERM) 01:26:37.226890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8654): Terminating (SIGTERM) 01:26:37.268470 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8657): Terminating (SIGTERM) 01:26:37.310262 --- ParallelTerminationStrategy: PID 8651 died... 01:26:37.330214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8651): Terminated: ok {rc=0} 01:26:37.375854 --- ParallelTerminationStrategy: PID 8654 died... 01:26:37.395333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8654): Terminated: ok {rc=0} 01:26:37.441107 --- ParallelTerminationStrategy: PID 8657 died... 01:26:37.460480 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8657): Terminated: ok {rc=0} 01:26:37.546992 bus /sierra_3: Setting Powered False 01:26:38.646869 bus /sierra_3: Setting Powered False 01:26:39.762396 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 01:26:40.911175 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:26:40.923407 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 01:26:40.999352 tst mo_mt_call_osmux.py: using LAC 25028 01:26:41.124476 tst mo_mt_call_osmux.py: using RAC 38 01:26:41.248575 tst mo_mt_call_osmux.py: using CellId 25028 01:26:41.372566 tst mo_mt_call_osmux.py: using BVCI 25029 01:26:41.488440 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:26:41.500192 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:26:41.511580 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:26:41.522986 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:26:41.534410 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:26:41.545706 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:26:41.661056 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:26:41.782357 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:26:42.281821 run create_hlr_db(pid=8660): Launched 01:26:42.415906 bus /sierra_2: Setting Powered False 01:26:43.479975 run create_hlr_db(pid=8660): Terminated: ok {rc=0} 01:26:43.909258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8662): Launched 01:26:44.211534 run osmo-hlr_10.42.42.2(pid=8663): Launched 01:26:44.327750 run osmo-stp_10.42.42.5: Starting osmo-stp 01:26:44.851309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8665): Launched 01:26:45.153192 run osmo-stp_10.42.42.5(pid=8666): Launched 01:26:45.268764 run osmo-msc_10.42.42.6: Starting osmo-msc 01:26:45.815688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8668): Launched 01:26:46.165350 run osmo-msc_10.42.42.6(pid=8669): Launched 01:26:46.620662 run osmo-stp_10.42.42.5(pid=8666): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8666)] 01:26:46.883936 run osmo-stp_10.42.42.5(pid=8666): stdout: | (launched: 2022-12-10_01:26:45.097889) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:47.057615 run osmo-stp_10.42.42.5(pid=8666): stderr: | 20221210012645270 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012645270 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012645270 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012645270 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012645271 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012645271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012645271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:47.226294 run osmo-stp_10.42.42.5(pid=8666): stdout: | (launched: 2022-12-10_01:26:45.097889) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:47.371930 run osmo-stp_10.42.42.5(pid=8666): stderr: | 20221210012645270 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012645270 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012645270 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012645270 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012645271 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012645271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012645271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:47.528086 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8666): Process ended prematurely: osmo-stp_10.42.42.5(pid=8666) [trial-2367↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8666)] [trial-2367↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 01:26:47.537958 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 01:26:47.566426 run osmo-hlr_10.42.42.2(pid=8663): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8663)] 01:26:47.617180 run osmo-hlr_10.42.42.2(pid=8663): stdout: | (launched: 2022-12-10_01:26:44.156270) 01:26:47.669507 run osmo-hlr_10.42.42.2(pid=8663): stderr: | 20221210012644334 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012644334 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012644334 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012644334 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012644334 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012644334 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012644347 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012644355 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012644355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012644356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:26:47.742415 run osmo-msc_10.42.42.6(pid=8669): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8669)] 01:26:47.792795 run osmo-msc_10.42.42.6(pid=8669): stdout: | (launched: 2022-12-10_01:26:46.105832) 01:26:47.845354 run osmo-msc_10.42.42.6(pid=8669): stderr: | 20221210012646517 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210012646517 DLGLOBAL DEBUG validating counter group 0x7f2fc6151c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210012646518 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210012646518 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210012646518 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210012646519 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210012646525 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210012646527 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210012646527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210012646527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:26:47.897945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8662): Terminating (SIGTERM) 01:26:47.939850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8665): Terminating (SIGTERM) 01:26:47.981716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8668): Terminating (SIGTERM) 01:26:48.023918 --- ParallelTerminationStrategy: PID 8662 died... 01:26:48.044130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8662): Terminated: ok {rc=0} 01:26:48.090488 --- ParallelTerminationStrategy: PID 8665 died... 01:26:48.110527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8665): Terminated: ok {rc=0} 01:26:48.157365 --- ParallelTerminationStrategy: PID 8668 died... 01:26:48.177197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8668): Terminated: ok {rc=0} 01:26:48.265833 bus /sierra_3: Setting Powered False 01:26:49.367264 bus /sierra_3: Setting Powered False 01:26:50.484622 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 01:26:51.743682 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:26:51.750699 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 01:26:51.784453 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 01:26:51.811488 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 01:26:51.864466 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 01:26:51.898072 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 01:26:51.924840 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 01:26:52.476878 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 01:26:52.528030 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:26:52.539475 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:26:52.609649 tst mo_mt_call.py: using LAC 25029 01:26:52.731616 tst mo_mt_call.py: using RAC 39 01:26:52.850441 tst mo_mt_call.py: using CellId 25029 01:26:52.969321 tst mo_mt_call.py: using BVCI 25030 01:26:53.079284 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:26:53.090511 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:26:53.101596 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:26:53.112925 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:26:53.124261 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:26:53.135373 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:26:53.251180 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:26:53.369238 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:26:53.870219 run create_hlr_db(pid=8674): Launched 01:26:54.003653 bus /sierra_2: Setting Powered False 01:26:55.066919 run create_hlr_db(pid=8674): Terminated: ok {rc=0} 01:26:55.495128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8676): Launched 01:26:55.798027 run osmo-hlr_10.42.42.2(pid=8677): Launched 01:26:55.913656 run osmo-stp_10.42.42.5: Starting osmo-stp 01:26:56.452934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8679): Launched 01:26:56.755108 run osmo-stp_10.42.42.5(pid=8680): Launched 01:26:56.870512 run osmo-msc_10.42.42.6: Starting osmo-msc 01:26:57.415054 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8682): Launched 01:26:57.716324 run osmo-msc_10.42.42.6(pid=8683): Launched 01:26:57.886509 run osmo-stp_10.42.42.5(pid=8680): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8680)] 01:26:58.015241 run osmo-stp_10.42.42.5(pid=8680): stdout: | (launched: 2022-12-10_01:26:56.699168) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:58.142933 run osmo-stp_10.42.42.5(pid=8680): stderr: | 20221210012656868 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012656869 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012656869 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012656869 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012656872 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012656872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012656872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:58.269189 run osmo-stp_10.42.42.5(pid=8680): stdout: | (launched: 2022-12-10_01:26:56.699168) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:58.389108 run osmo-stp_10.42.42.5(pid=8680): stderr: | 20221210012656868 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012656869 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012656869 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012656869 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012656872 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012656872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012656872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:58.532705 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8680): Process ended prematurely: osmo-stp_10.42.42.5(pid=8680) [trial-2367↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8680)] [trial-2367↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 01:26:58.541929 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:26:58.569315 run osmo-hlr_10.42.42.2(pid=8677): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8677)] 01:26:58.617666 run osmo-hlr_10.42.42.2(pid=8677): stdout: | (launched: 2022-12-10_01:26:55.742537) 01:26:58.667120 run osmo-hlr_10.42.42.2(pid=8677): stderr: | 20221210012655917 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012655917 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012655917 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012655917 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012655917 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012655917 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012655930 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012655941 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012655941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012655941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:26:58.735771 run osmo-msc_10.42.42.6(pid=8683): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8683)] 01:26:58.783331 run osmo-msc_10.42.42.6(pid=8683): stdout: | (launched: 2022-12-10_01:26:57.661138) 01:26:58.832582 run osmo-msc_10.42.42.6(pid=8683): stderr: | 20221210012657933 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210012657933 DLGLOBAL DEBUG validating counter group 0x7f5e587e3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210012657933 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210012657933 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210012657933 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210012657933 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210012657935 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210012657935 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210012657936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210012657936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:26:58.882250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8676): Terminating (SIGTERM) 01:26:58.921926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8679): Terminating (SIGTERM) 01:26:58.961506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8682): Terminating (SIGTERM) 01:26:59.001719 --- ParallelTerminationStrategy: PID 8676 died... 01:26:59.020560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8676): Terminated: ok {rc=0} 01:26:59.064777 --- ParallelTerminationStrategy: PID 8679 died... 01:26:59.083207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8679): Terminated: ok {rc=0} 01:26:59.127190 --- ParallelTerminationStrategy: PID 8682 died... 01:26:59.145674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8682): Terminated: ok {rc=0} 01:26:59.231038 bus /sierra_3: Setting Powered False 01:27:00.327965 bus /sierra_3: Setting Powered False 01:27:01.437119 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 01:27:02.581544 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:27:02.593410 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:27:02.662112 tst mo_mt_call_osmux.py: using LAC 25030 01:27:02.782718 tst mo_mt_call_osmux.py: using RAC 40 01:27:02.902735 tst mo_mt_call_osmux.py: using CellId 25030 01:27:03.021933 tst mo_mt_call_osmux.py: using BVCI 25031 01:27:03.130522 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:27:03.141651 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:27:03.152395 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:27:03.163702 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:27:03.175048 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:27:03.186347 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:27:03.304485 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:27:03.421839 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:27:03.887602 run create_hlr_db(pid=8685): Launched 01:27:04.002135 bus /sierra_2: Setting Powered False 01:27:05.062319 run create_hlr_db(pid=8685): Terminated: ok {rc=0} 01:27:05.500641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8687): Launched 01:27:05.821254 run osmo-hlr_10.42.42.2(pid=8688): Launched 01:27:05.944829 run osmo-stp_10.42.42.5: Starting osmo-stp 01:27:06.502215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8690): Launched 01:27:06.823900 run osmo-stp_10.42.42.5(pid=8691): Launched 01:27:06.947367 run osmo-msc_10.42.42.6: Starting osmo-msc 01:27:07.528030 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8693): Launched 01:27:07.849510 run osmo-msc_10.42.42.6(pid=8694): Launched 01:27:08.030260 run osmo-stp_10.42.42.5(pid=8691): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8691)] 01:27:08.165755 run osmo-stp_10.42.42.5(pid=8691): stdout: | (launched: 2022-12-10_01:27:06.765085) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:27:08.302379 run osmo-stp_10.42.42.5(pid=8691): stderr: | 20221210012706959 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012706959 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012706960 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012706960 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012706961 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012706961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012706961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:27:08.437793 run osmo-stp_10.42.42.5(pid=8691): stdout: | (launched: 2022-12-10_01:27:06.765085) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:27:08.566378 run osmo-stp_10.42.42.5(pid=8691): stderr: | 20221210012706959 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012706959 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012706960 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012706960 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012706961 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012706961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012706961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:27:08.719927 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8691): Process ended prematurely: osmo-stp_10.42.42.5(pid=8691) [trial-2367↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8691)] [trial-2367↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 01:27:08.729749 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 01:27:08.757845 run osmo-hlr_10.42.42.2(pid=8688): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8688)] 01:27:08.807869 run osmo-hlr_10.42.42.2(pid=8688): stdout: | (launched: 2022-12-10_01:27:05.762873) 01:27:08.859714 run osmo-hlr_10.42.42.2(pid=8688): stderr: | 20221210012705963 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012705963 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012705963 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012705963 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012705963 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012705963 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012705975 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012705985 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012705985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012705985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:27:08.931530 run osmo-msc_10.42.42.6(pid=8694): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8694)] 01:27:08.981273 run osmo-msc_10.42.42.6(pid=8694): stdout: | (launched: 2022-12-10_01:27:07.790989) 01:27:09.032675 run osmo-msc_10.42.42.6(pid=8694): stderr: | 20221210012708111 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210012708112 DLGLOBAL DEBUG validating counter group 0x7f38803fbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210012708112 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210012708112 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210012708112 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210012708112 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210012708114 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210012708114 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210012708114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210012708114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:27:09.084218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8687): Terminating (SIGTERM) 01:27:09.125754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8690): Terminating (SIGTERM) 01:27:09.167357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8693): Terminating (SIGTERM) 01:27:09.209199 --- ParallelTerminationStrategy: PID 8687 died... 01:27:09.228712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8687): Terminated: ok {rc=0} 01:27:09.274927 --- ParallelTerminationStrategy: PID 8690 died... 01:27:09.294490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8690): Terminated: ok {rc=0} 01:27:09.340283 --- ParallelTerminationStrategy: PID 8693 died... 01:27:09.359985 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8693): Terminated: ok {rc=0} 01:27:09.447193 bus /sierra_3: Setting Powered False 01:27:10.544322 bus /sierra_3: Setting Powered False 01:27:11.655100 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:27:12.909162 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:27:12.916278 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:27:12.950640 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 01:27:12.977906 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:27:13.032189 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:27:13.065038 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 01:27:13.091446 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:27:13.645395 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 01:27:13.699310 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:27:13.711149 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:27:13.783684 tst mo_mt_call.py: using LAC 25031 01:27:13.912812 tst mo_mt_call.py: using RAC 41 01:27:14.040366 tst mo_mt_call.py: using CellId 25031 01:27:14.169163 tst mo_mt_call.py: using BVCI 25032 01:27:14.286700 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:27:14.298473 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:27:14.310026 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:27:14.321862 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:27:14.333660 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:27:14.345374 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:27:14.461622 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:27:14.575098 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:27:15.042329 run create_hlr_db(pid=8699): Launched 01:27:15.159802 bus /sierra_2: Setting Powered False 01:27:16.218123 run create_hlr_db(pid=8699): Terminated: ok {rc=0} 01:27:16.654900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8701): Launched 01:27:16.977381 run osmo-hlr_10.42.42.2(pid=8702): Launched 01:27:17.199745 run osmo-stp_10.42.42.5: Starting osmo-stp 01:27:17.730915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8704): Launched 01:27:18.032599 run osmo-stp_10.42.42.5(pid=8705): Launched 01:27:18.148701 run osmo-msc_10.42.42.6: Starting osmo-msc 01:27:18.696321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8707): Launched 01:27:18.999039 run osmo-msc_10.42.42.6(pid=8708): Launched 01:27:19.169578 run osmo-stp_10.42.42.5(pid=8705): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8705)] 01:27:19.297437 run osmo-stp_10.42.42.5(pid=8705): stdout: | (launched: 2022-12-10_01:27:17.977308) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:27:19.425497 run osmo-stp_10.42.42.5(pid=8705): stderr: | 20221210012718147 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012718147 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012718147 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012718147 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012718150 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012718150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012718150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:27:19.551445 run osmo-stp_10.42.42.5(pid=8705): stdout: | (launched: 2022-12-10_01:27:17.977308) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:27:19.671147 run osmo-stp_10.42.42.5(pid=8705): stderr: | 20221210012718147 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012718147 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012718147 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012718147 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012718150 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012718150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012718150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:27:19.815033 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8705): Process ended prematurely: osmo-stp_10.42.42.5(pid=8705) [trial-2367↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8705)] [trial-2367↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 01:27:19.824165 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 01:27:19.851115 run osmo-hlr_10.42.42.2(pid=8702): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8702)] 01:27:19.898765 run osmo-hlr_10.42.42.2(pid=8702): stdout: | (launched: 2022-12-10_01:27:16.921476) 01:27:19.947880 run osmo-hlr_10.42.42.2(pid=8702): stderr: | 20221210012717223 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012717223 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012717223 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012717223 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012717223 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012717223 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012717235 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012717244 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012717244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012717244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:27:20.016463 run osmo-msc_10.42.42.6(pid=8708): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8708)] 01:27:20.063750 run osmo-msc_10.42.42.6(pid=8708): stdout: | (launched: 2022-12-10_01:27:18.943666) 01:27:20.112666 run osmo-msc_10.42.42.6(pid=8708): stderr: | 20221210012719214 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210012719214 DLGLOBAL DEBUG validating counter group 0x7f9d99207c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210012719214 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210012719215 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210012719215 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210012719215 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210012719217 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210012719217 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210012719217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210012719217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:27:20.162170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8701): Terminating (SIGTERM) 01:27:20.201460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8704): Terminating (SIGTERM) 01:27:20.241203 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8707): Terminating (SIGTERM) 01:27:20.280716 --- ParallelTerminationStrategy: PID 8701 died... 01:27:20.299678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8701): Terminated: ok {rc=0} 01:27:20.344314 --- ParallelTerminationStrategy: PID 8704 died... 01:27:20.362895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8704): Terminated: ok {rc=0} 01:27:20.406764 --- ParallelTerminationStrategy: PID 8707 died... 01:27:20.425132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8707): Terminated: ok {rc=0} 01:27:20.508564 bus /sierra_3: Setting Powered False 01:27:21.603511 bus /sierra_3: Setting Powered False 01:27:22.719184 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 01:27:23.864165 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:27:23.876078 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:27:23.946381 tst mo_mt_call_osmux.py: using LAC 25032 01:27:24.064936 tst mo_mt_call_osmux.py: using RAC 42 01:27:24.184079 tst mo_mt_call_osmux.py: using CellId 25032 01:27:24.303151 tst mo_mt_call_osmux.py: using BVCI 25033 01:27:24.413731 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:27:24.424848 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:27:24.435876 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:27:24.447243 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:27:24.458508 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:27:24.469657 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:27:24.588205 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:27:24.707493 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:27:25.208805 run create_hlr_db(pid=8710): Launched 01:27:25.343047 bus /sierra_2: Setting Powered False 01:27:26.406958 run create_hlr_db(pid=8710): Terminated: ok {rc=0} 01:27:26.839080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8712): Launched 01:27:27.142206 run osmo-hlr_10.42.42.2(pid=8713): Launched 01:27:27.257717 run osmo-stp_10.42.42.5: Starting osmo-stp 01:27:27.791895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8715): Launched 01:27:28.093977 run osmo-stp_10.42.42.5(pid=8716): Launched 01:27:28.209895 run osmo-msc_10.42.42.6: Starting osmo-msc 01:27:28.759649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8718): Launched 01:27:29.061404 run osmo-msc_10.42.42.6(pid=8719): Launched 01:27:29.231201 run osmo-stp_10.42.42.5(pid=8716): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8716)] 01:27:29.359775 run osmo-stp_10.42.42.5(pid=8716): stdout: | (launched: 2022-12-10_01:27:28.038748) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:27:29.487805 run osmo-stp_10.42.42.5(pid=8716): stderr: | 20221210012728207 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012728207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012728207 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012728208 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012728210 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012728210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012728210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:27:29.613633 run osmo-stp_10.42.42.5(pid=8716): stdout: | (launched: 2022-12-10_01:27:28.038748) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:27:29.734200 run osmo-stp_10.42.42.5(pid=8716): stderr: | 20221210012728207 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012728207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012728207 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012728208 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012728210 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012728210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012728210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:27:29.879432 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8716): Process ended prematurely: osmo-stp_10.42.42.5(pid=8716) [trial-2367↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8716)] [trial-2367↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 01:27:29.888290 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 01:27:29.914962 run osmo-hlr_10.42.42.2(pid=8713): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8713)] 01:27:29.962825 run osmo-hlr_10.42.42.2(pid=8713): stdout: | (launched: 2022-12-10_01:27:27.086665) 01:27:30.011580 run osmo-hlr_10.42.42.2(pid=8713): stderr: | 20221210012727261 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012727261 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012727261 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012727262 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012727262 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012727262 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012727274 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012727282 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012727283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012727283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:27:30.080664 run osmo-msc_10.42.42.6(pid=8719): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8719)] 01:27:30.128105 run osmo-msc_10.42.42.6(pid=8719): stdout: | (launched: 2022-12-10_01:27:29.006122) 01:27:30.177227 run osmo-msc_10.42.42.6(pid=8719): stderr: | 20221210012729278 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210012729278 DLGLOBAL DEBUG validating counter group 0x7fae75d76c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210012729278 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210012729278 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210012729278 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210012729279 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210012729280 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210012729281 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210012729281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210012729281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:27:30.226744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8712): Terminating (SIGTERM) 01:27:30.266209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8715): Terminating (SIGTERM) 01:27:30.305859 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8718): Terminating (SIGTERM) 01:27:30.345725 --- ParallelTerminationStrategy: PID 8712 died... 01:27:30.364475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8712): Terminated: ok {rc=0} 01:27:30.408576 --- ParallelTerminationStrategy: PID 8715 died... 01:27:30.427051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8715): Terminated: ok {rc=0} 01:27:30.471078 --- ParallelTerminationStrategy: PID 8718 died... 01:27:30.489446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8718): Terminated: ok {rc=0} 01:27:30.574919 bus /sierra_3: Setting Powered False 01:27:31.688729 bus /sierra_3: Setting Powered False 01:27:32.807195 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 01:27:34.063219 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:27:34.069781 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 01:27:34.103664 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 01:27:34.130620 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 01:27:34.183903 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 01:27:34.217537 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 01:27:34.244554 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 01:27:34.793910 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 01:27:34.846111 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:27:34.857164 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:27:34.930929 tst mo_mt_call.py: using LAC 25033 01:27:35.048645 tst mo_mt_call.py: using RAC 43 01:27:35.164731 tst mo_mt_call.py: using CellId 25033 01:27:35.281273 tst mo_mt_call.py: using BVCI 25034 01:27:35.389923 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:27:35.400632 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:27:35.411353 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:27:35.422328 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:27:35.433327 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:27:35.444160 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:27:35.562070 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:27:35.681911 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:27:36.151066 run create_hlr_db(pid=8727): Launched 01:27:36.266043 bus /sierra_2: Setting Powered False 01:27:37.325371 run create_hlr_db(pid=8727): Terminated: ok {rc=0} 01:27:37.764286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8729): Launched 01:27:38.086255 run osmo-hlr_10.42.42.2(pid=8730): Launched 01:27:38.211861 run osmo-stp_10.42.42.5: Starting osmo-stp 01:27:38.772503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8732): Launched 01:27:39.095483 run osmo-stp_10.42.42.5(pid=8733): Launched 01:27:39.219073 run osmo-msc_10.42.42.6: Starting osmo-msc 01:27:39.803181 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8735): Launched 01:27:40.120877 run osmo-msc_10.42.42.6(pid=8736): Launched 01:27:40.293240 run osmo-stp_10.42.42.5(pid=8733): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8733)] 01:27:40.421995 run osmo-stp_10.42.42.5(pid=8733): stdout: | (launched: 2022-12-10_01:27:39.036883) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:27:40.550367 run osmo-stp_10.42.42.5(pid=8733): stderr: | 20221210012739226 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012739226 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012739226 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012739227 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012739227 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012739227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012739227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:27:40.676465 run osmo-stp_10.42.42.5(pid=8733): stdout: | (launched: 2022-12-10_01:27:39.036883) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:27:40.796766 run osmo-stp_10.42.42.5(pid=8733): stderr: | 20221210012739226 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012739226 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012739226 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012739227 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012739227 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012739227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012739227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:27:40.941086 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8733): Process ended prematurely: osmo-stp_10.42.42.5(pid=8733) [trial-2367↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8733)] [trial-2367↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 01:27:40.950010 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:27:40.976909 run osmo-hlr_10.42.42.2(pid=8730): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8730)] 01:27:41.024634 run osmo-hlr_10.42.42.2(pid=8730): stdout: | (launched: 2022-12-10_01:27:38.027800) 01:27:41.074113 run osmo-hlr_10.42.42.2(pid=8730): stderr: | 20221210012738224 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012738224 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012738224 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012738224 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012738224 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012738224 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012738237 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012738245 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012738245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012738245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:27:41.143358 run osmo-msc_10.42.42.6(pid=8736): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8736)] 01:27:41.190987 run osmo-msc_10.42.42.6(pid=8736): stdout: | (launched: 2022-12-10_01:27:40.065269) 01:27:41.240288 run osmo-msc_10.42.42.6(pid=8736): stderr: | 20221210012740337 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210012740337 DLGLOBAL DEBUG validating counter group 0x7f26c41bdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210012740337 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210012740337 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210012740337 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210012740338 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210012740339 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210012740340 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210012740340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210012740340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:27:41.289898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8729): Terminating (SIGTERM) 01:27:41.329366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8732): Terminating (SIGTERM) 01:27:41.369166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8735): Terminating (SIGTERM) 01:27:41.408804 --- ParallelTerminationStrategy: PID 8729 died... 01:27:41.427747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8729): Terminated: ok {rc=0} 01:27:41.471509 --- ParallelTerminationStrategy: PID 8732 died... 01:27:41.490201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8732): Terminated: ok {rc=0} 01:27:41.533866 --- ParallelTerminationStrategy: PID 8735 died... 01:27:41.552170 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8735): Terminated: ok {rc=0} 01:27:41.637878 bus /sierra_3: Setting Powered False 01:27:42.737076 bus /sierra_3: Setting Powered False 01:27:43.851895 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 01:27:44.993241 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:27:45.004796 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:27:45.078871 tst mo_mt_call_osmux.py: using LAC 25034 01:27:45.195988 tst mo_mt_call_osmux.py: using RAC 44 01:27:45.312051 tst mo_mt_call_osmux.py: using CellId 25034 01:27:45.428048 tst mo_mt_call_osmux.py: using BVCI 25035 01:27:45.536755 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:27:45.547623 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:27:45.558331 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:27:45.569272 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:27:45.580114 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:27:45.591059 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:27:45.710774 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:27:45.828139 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:27:46.366388 run create_hlr_db(pid=8738): Launched 01:27:46.525622 bus /sierra_2: Setting Powered False 01:27:47.588590 run create_hlr_db(pid=8738): Terminated: ok {rc=0} 01:27:48.041646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8740): Launched 01:27:48.346488 run osmo-hlr_10.42.42.2(pid=8741): Launched 01:27:48.463509 run osmo-stp_10.42.42.5: Starting osmo-stp 01:27:48.981702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8743): Launched 01:27:49.283642 run osmo-stp_10.42.42.5(pid=8744): Launched 01:27:49.399037 run osmo-msc_10.42.42.6: Starting osmo-msc 01:27:49.943220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8746): Launched 01:27:50.245311 run osmo-msc_10.42.42.6(pid=8747): Launched 01:27:50.415149 run osmo-stp_10.42.42.5(pid=8744): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8744)] 01:27:50.542796 run osmo-stp_10.42.42.5(pid=8744): stdout: | (launched: 2022-12-10_01:27:49.228470) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:27:50.671201 run osmo-stp_10.42.42.5(pid=8744): stderr: | 20221210012749398 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012749398 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012749398 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012749399 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012749399 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012749399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012749399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:27:50.796413 run osmo-stp_10.42.42.5(pid=8744): stdout: | (launched: 2022-12-10_01:27:49.228470) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:27:50.916524 run osmo-stp_10.42.42.5(pid=8744): stderr: | 20221210012749398 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012749398 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012749398 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012749399 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012749399 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012749399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012749399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:27:51.060678 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8744): Process ended prematurely: osmo-stp_10.42.42.5(pid=8744) [trial-2367↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8744)] [trial-2367↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 01:27:51.069606 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 01:27:51.096540 run osmo-hlr_10.42.42.2(pid=8741): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8741)] 01:27:51.144517 run osmo-hlr_10.42.42.2(pid=8741): stdout: | (launched: 2022-12-10_01:27:48.290980) 01:27:51.193786 run osmo-hlr_10.42.42.2(pid=8741): stderr: | 20221210012748467 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012748467 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012748467 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012748467 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012748467 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012748467 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012748482 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012748491 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012748491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012748491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:27:51.262680 run osmo-msc_10.42.42.6(pid=8747): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8747)] 01:27:51.310255 run osmo-msc_10.42.42.6(pid=8747): stdout: | (launched: 2022-12-10_01:27:50.189901) 01:27:51.359618 run osmo-msc_10.42.42.6(pid=8747): stderr: | 20221210012750464 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210012750464 DLGLOBAL DEBUG validating counter group 0x7f3bb6767c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210012750464 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210012750464 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210012750464 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210012750464 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210012750467 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210012750468 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210012750468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210012750468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:27:51.409486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8740): Terminating (SIGTERM) 01:27:51.449304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8743): Terminating (SIGTERM) 01:27:51.489211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8746): Terminating (SIGTERM) 01:27:51.529295 --- ParallelTerminationStrategy: PID 8740 died... 01:27:51.548396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8740): Terminated: ok {rc=0} 01:27:51.592431 --- ParallelTerminationStrategy: PID 8743 died... 01:27:51.611078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8743): Terminated: ok {rc=0} 01:27:51.655518 --- ParallelTerminationStrategy: PID 8746 died... 01:27:51.674144 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8746): Terminated: ok {rc=0} 01:27:51.760198 bus /sierra_3: Setting Powered False 01:27:52.859789 bus /sierra_3: Setting Powered False 01:27:53.976399 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 emergency:trx-lms --------------------------------------------------------------------- 01:27:55.226541 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:27:55.231432 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 01:27:55.266950 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 01:27:55.294236 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 01:27:55.381425 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 01:27:55.415585 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 01:27:55.443271 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 01:27:56.026487 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2367 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 01:27:56.031663 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:27:56.042879 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 01:27:56.093142 tst emergency_mo_mt_call.py: using LAC 25035 01:27:56.217806 tst emergency_mo_mt_call.py: using RAC 45 01:27:56.342761 tst emergency_mo_mt_call.py: using CellId 25035 01:27:56.468538 tst emergency_mo_mt_call.py: using BVCI 25036 01:27:56.583963 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:27:56.595045 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:27:56.605942 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:27:56.617382 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:27:56.628692 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:27:56.640033 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 01:27:56.756070 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 01:27:56.873354 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:27:57.332681 run create_hlr_db(pid=8752): Launched 01:27:57.447156 bus /sierra_2: Setting Powered False 01:27:58.506264 run create_hlr_db(pid=8752): Terminated: ok {rc=0} 01:27:58.919330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8754): Launched 01:27:59.215406 run osmo-hlr_10.42.42.2(pid=8755): Launched 01:27:59.328412 run osmo-stp_10.42.42.5: Starting osmo-stp 01:27:59.851420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8757): Launched 01:28:00.148403 run osmo-stp_10.42.42.5(pid=8758): Launched 01:28:00.271956 tst emergency_mo_mt_call.py: using MSISDN 7477 01:28:00.423564 run osmo-msc_10.42.42.6: Starting osmo-msc 01:28:00.985823 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8760): Launched 01:28:01.326597 run osmo-msc_10.42.42.6(pid=8761): Launched 01:28:01.717489 run osmo-stp_10.42.42.5(pid=8758): ERR: Terminated: ERROR {rc=1} [trial-2367↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8758)] 01:28:01.982340 run osmo-stp_10.42.42.5(pid=8758): stdout: | (launched: 2022-12-10_01:28:00.093780) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:28:02.222999 run osmo-stp_10.42.42.5(pid=8758): stderr: | 20221210012800264 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012800264 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012800264 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012800266 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012800267 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012800267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012800267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:28:02.348422 run osmo-stp_10.42.42.5(pid=8758): stdout: | (launched: 2022-12-10_01:28:00.093780) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:28:02.466306 run osmo-stp_10.42.42.5(pid=8758): stderr: | 20221210012800264 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012800264 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012800264 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012800266 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012800267 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012800267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012800267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:28:02.607601 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=8758): Process ended prematurely: osmo-stp_10.42.42.5(pid=8758) [trial-2367↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8758)] [trial-2367↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 01:28:02.616045 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 01:28:02.642747 run osmo-hlr_10.42.42.2(pid=8755): ERR: Terminated: ERROR {rc=237} [trial-2367↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8755)] 01:28:02.690988 run osmo-hlr_10.42.42.2(pid=8755): stdout: | (launched: 2022-12-10_01:27:59.160900) 01:28:02.741698 run osmo-hlr_10.42.42.2(pid=8755): stderr: | 20221210012759336 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012759336 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012759336 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012759336 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012759336 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012759337 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012759347 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012759356 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012759357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012759357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:28:02.810936 run osmo-msc_10.42.42.6(pid=8761): ERR: Terminated: ERROR {rc=2} [trial-2367↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8761)] 01:28:02.859132 run osmo-msc_10.42.42.6(pid=8761): stdout: | (launched: 2022-12-10_01:28:01.268590) 01:28:02.909428 run osmo-msc_10.42.42.6(pid=8761): stderr: | 20221210012801740 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210012801741 DLGLOBAL DEBUG validating counter group 0x7f4bdbe95c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210012801741 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210012801741 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210012801741 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210012801741 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210012801743 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210012801743 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210012801743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210012801743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:28:02.959693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8754): Terminating (SIGTERM) 01:28:02.999544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8757): Terminating (SIGTERM) 01:28:03.039603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8760): Terminating (SIGTERM) 01:28:03.080133 --- ParallelTerminationStrategy: PID 8754 died... 01:28:03.099440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8754): Terminated: ok {rc=0} 01:28:03.144276 --- ParallelTerminationStrategy: PID 8757 died... 01:28:03.163038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8757): Terminated: ok {rc=0} 01:28:03.207914 --- ParallelTerminationStrategy: PID 8760 died... 01:28:03.226699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8760): Terminated: ok {rc=0} 01:28:03.314106 bus /sierra_3: Setting Powered False 01:28:04.414766 bus /sierra_3: Setting Powered False 01:28:05.530903 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 01:28:06.617781 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:28:06.629235 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 01:28:06.679843 tst emergency_preemptive_call.py: using LAC 25036 01:28:06.798038 tst emergency_preemptive_call.py: using RAC 46 01:28:06.913377 tst emergency_preemptive_call.py: using CellId 25036 01:28:07.028604 tst emergency_preemptive_call.py: using BVCI 25037 01:28:07.135275 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:28:07.145913 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:28:07.156212 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:28:07.166810 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:28:07.177709 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:28:07.188245 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 01:28:07.302210 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 01:28:07.415506 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 01:28:07.531761 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 01:28:07.650706 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:28:08.112226 run create_hlr_db(pid=8763): Launched 01:28:08.225728 bus /sierra_2: Setting Powered False 01:28:09.284675 run create_hlr_db(pid=8763): Terminated: ok {rc=0} 01:28:09.715721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8765): Launched 01:28:10.033286 run osmo-hlr_10.42.42.2(pid=8766): Launched 01:28:10.155009 run osmo-stp_10.42.42.5: Starting osmo-stp 01:28:10.704326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8768): Launched 01:28:11.021923 run osmo-stp_10.42.42.5(pid=8769): Launched 01:28:11.154733 tst emergency_preemptive_call.py: using MSISDN 7478 01:28:11.318203 run osmo-msc_10.42.42.6: Starting osmo-msc 01:28:11.888335 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8771): Launched 01:28:12.205235 run osmo-msc_10.42.42.6(pid=8772): Launched 01:28:12.383285 run osmo-stp_10.42.42.5(pid=8769): ERR: Terminated: ERROR {rc=1} [trial-2367↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8769)] 01:28:12.516465 run osmo-stp_10.42.42.5(pid=8769): stdout: | (launched: 2022-12-10_01:28:10.963849) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:28:12.649736 run osmo-stp_10.42.42.5(pid=8769): stderr: | 20221210012811158 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012811158 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012811158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012811158 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012811159 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012811159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012811159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:28:12.783097 run osmo-stp_10.42.42.5(pid=8769): stdout: | (launched: 2022-12-10_01:28:10.963849) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:28:12.909518 run osmo-stp_10.42.42.5(pid=8769): stderr: | 20221210012811158 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012811158 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012811158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012811158 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012811159 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012811159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012811159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:28:13.059999 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=8769): Process ended prematurely: osmo-stp_10.42.42.5(pid=8769) [trial-2367↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8769)] [trial-2367↪emergency:trx-lms↪emergency_preemptive_call.py:32] 01:28:13.069180 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 01:28:13.097293 run osmo-hlr_10.42.42.2(pid=8766): ERR: Terminated: ERROR {rc=237} [trial-2367↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8766)] 01:28:13.147922 run osmo-hlr_10.42.42.2(pid=8766): stdout: | (launched: 2022-12-10_01:28:09.975168) 01:28:13.199774 run osmo-hlr_10.42.42.2(pid=8766): stderr: | 20221210012810174 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012810174 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012810174 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012810174 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012810174 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012810174 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012810187 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012810197 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012810197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012810197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:28:13.272003 run osmo-msc_10.42.42.6(pid=8772): ERR: Terminated: ERROR {rc=2} [trial-2367↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8772)] 01:28:13.322199 run osmo-msc_10.42.42.6(pid=8772): stdout: | (launched: 2022-12-10_01:28:12.147586) 01:28:13.373535 run osmo-msc_10.42.42.6(pid=8772): stderr: | 20221210012812470 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210012812470 DLGLOBAL DEBUG validating counter group 0x7fb09bf92c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210012812470 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210012812470 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210012812470 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210012812471 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210012812472 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210012812473 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210012812473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210012812473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:28:13.424905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8765): Terminating (SIGTERM) 01:28:13.466629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8768): Terminating (SIGTERM) 01:28:13.508471 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8771): Terminating (SIGTERM) 01:28:13.550492 --- ParallelTerminationStrategy: PID 8765 died... 01:28:13.570422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8765): Terminated: ok {rc=0} 01:28:13.616798 --- ParallelTerminationStrategy: PID 8768 died... 01:28:13.636211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8768): Terminated: ok {rc=0} 01:28:13.682297 --- ParallelTerminationStrategy: PID 8771 died... 01:28:13.701818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8771): Terminated: ok {rc=0} 01:28:13.789872 bus /sierra_9: Setting Powered False 01:28:14.887905 bus /sierra_9: Setting Powered False 01:28:16.003561 bus /sierra_8: Setting Powered False 01:28:17.100652 bus /sierra_8: Setting Powered False 01:28:18.215173 bus /sierra_3: Setting Powered False 01:28:19.310390 bus /sierra_3: Setting Powered False 01:28:20.424642 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:trx-lms --------------------------------------------------------------------- 01:28:21.704633 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:28:21.709309 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 01:28:21.742920 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 01:28:21.781929 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 01:28:21.870455 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 01:28:21.904542 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 01:28:21.943966 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 01:28:22.537852 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 01:28:22.592035 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:22.603010 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 01:28:22.657423 tst cs_paging_gprs_active.py: using LAC 25037 01:28:22.776646 tst cs_paging_gprs_active.py: using RAC 47 01:28:22.897427 tst cs_paging_gprs_active.py: using CellId 25037 01:28:23.017028 tst cs_paging_gprs_active.py: using BVCI 25038 01:28:23.127815 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:23.138582 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:23.148942 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:23.159488 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:23.170145 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:23.180504 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:23.191235 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:23.201740 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:23.212356 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 01:28:23.330710 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 01:28:23.448082 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:28:23.651469 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:28:23.954638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8777): Launched 01:28:24.218123 run iperf3-srv_10.42.42.10(pid=8778): Launched 01:28:24.331552 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:28:24.533351 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:28:24.834908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8779): Launched 01:28:25.097413 run iperf3-srv_10.42.42.10(pid=8780): Launched 01:28:25.211089 tst cs_paging_gprs_active.py:38: start network... 01:28:25.411833 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:28:25.878662 run create_hlr_db(pid=8781): Launched 01:28:25.994321 bus /sierra_2: Setting Powered False 01:28:27.054452 run create_hlr_db(pid=8781): Terminated: ok {rc=0} 01:28:27.475134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8783): Launched 01:28:27.779184 run osmo-hlr_10.42.42.2(pid=8784): Launched 01:28:27.894912 run osmo-stp_10.42.42.5: Starting osmo-stp 01:28:28.426892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8786): Launched 01:28:28.728486 run osmo-stp_10.42.42.5(pid=8787): Launched 01:28:28.843999 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:28:29.364510 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8789): Launched 01:28:29.480309 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:28:29.735085 run patchelf(pid=8790): Launched 01:28:29.903767 run osmo-stp_10.42.42.5(pid=8787): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8787)] 01:28:30.031793 run osmo-stp_10.42.42.5(pid=8787): stdout: | (launched: 2022-12-10_01:28:28.673105) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:28:30.161407 run osmo-stp_10.42.42.5(pid=8787): stderr: | 20221210012828845 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012828845 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012828845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012828846 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012828846 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012828846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012828846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:28:30.290730 run osmo-stp_10.42.42.5(pid=8787): stdout: | (launched: 2022-12-10_01:28:28.673105) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:28:30.414446 run osmo-stp_10.42.42.5(pid=8787): stderr: | 20221210012828845 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012828845 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012828845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012828846 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012828846 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012828846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012828846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:28:30.561738 run patchelf(pid=8790): Terminating (SIGINT) 01:28:30.730391 run patchelf(pid=8790): Terminated: ok {rc=0} 01:28:30.861261 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8787): Process ended prematurely: osmo-stp_10.42.42.5(pid=8787) [trial-2367↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8787)] [trial-2367↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 01:28:30.875658 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 01:28:30.922342 run osmo-hlr_10.42.42.2(pid=8784): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8784)] 01:28:30.974463 run osmo-hlr_10.42.42.2(pid=8784): stdout: | (launched: 2022-12-10_01:28:27.723831) 01:28:31.032274 run osmo-hlr_10.42.42.2(pid=8784): stderr: | 20221210012827902 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012827902 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012827902 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012827902 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012827902 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012827902 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012827914 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012827923 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012827923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012827923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:28:31.087542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8777): Terminating (SIGTERM) 01:28:31.130858 run iperf3-srv_10.42.42.10(pid=8778): Terminating (SIGTERM) 01:28:31.176546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8779): Terminating (SIGTERM) 01:28:31.220110 run iperf3-srv_10.42.42.10(pid=8780): Terminating (SIGTERM) 01:28:31.266565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8783): Terminating (SIGTERM) 01:28:31.311087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8786): Terminating (SIGTERM) 01:28:31.356390 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8789): Terminating (SIGTERM) 01:28:31.401828 --- ParallelTerminationStrategy: PID 8777 died... 01:28:31.421995 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8777): Terminated: ok {rc=0} 01:28:31.472218 --- ParallelTerminationStrategy: PID 8778 died... 01:28:31.492377 run iperf3-srv_10.42.42.10(pid=8778): Terminated {rc=256} 01:28:31.540186 --- ParallelTerminationStrategy: PID 8779 died... 01:28:31.560777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8779): Terminated: ok {rc=0} 01:28:31.608098 --- ParallelTerminationStrategy: PID 8780 died... 01:28:31.628717 run iperf3-srv_10.42.42.10(pid=8780): Terminated {rc=256} 01:28:31.677494 --- ParallelTerminationStrategy: PID 8783 died... 01:28:31.697754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8783): Terminated: ok {rc=0} 01:28:31.745201 --- ParallelTerminationStrategy: PID 8786 died... 01:28:31.765669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8786): Terminated: ok {rc=0} 01:28:31.816491 --- ParallelTerminationStrategy: PID 8789 died... 01:28:31.836889 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8789): Terminated: ok {rc=0} 01:28:31.938803 bus /gobi_0: Setting Powered False 01:28:33.049609 bus /gobi_0: Setting Powered False 01:28:34.165226 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-lms iperf3.py ---------------------------------------------- 01:28:35.310253 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:35.321688 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 01:28:35.374315 tst iperf3.py: using LAC 25038 01:28:35.502532 tst iperf3.py: using RAC 48 01:28:35.629792 tst iperf3.py: using CellId 25038 01:28:35.756427 tst iperf3.py: using BVCI 25039 01:28:35.873867 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:35.885051 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:35.896197 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:35.907130 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:35.919243 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:35.930067 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:35.941205 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:35.951905 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:35.962868 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 01:28:36.082043 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:28:36.299223 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:28:36.623364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8791): Launched 01:28:36.906953 run iperf3-srv_10.42.42.10(pid=8792): Launched 01:28:37.029968 tst iperf3.py:8: start network... 01:28:37.247025 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:28:37.749033 run create_hlr_db(pid=8793): Launched 01:28:37.882661 bus /gobi_6: Setting Powered False 01:28:38.946866 run create_hlr_db(pid=8793): Terminated: ok {rc=0} 01:28:39.378867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8795): Launched 01:28:39.683621 run osmo-hlr_10.42.42.2(pid=8796): Launched 01:28:39.799482 run osmo-stp_10.42.42.5: Starting osmo-stp 01:28:40.337647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8798): Launched 01:28:40.642879 run osmo-stp_10.42.42.5(pid=8799): Launched 01:28:40.758922 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:28:41.280664 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8801): Launched 01:28:41.396522 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:28:41.652099 run patchelf(pid=8802): Launched 01:28:41.820925 run osmo-stp_10.42.42.5(pid=8799): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8799)] 01:28:41.949358 run osmo-stp_10.42.42.5(pid=8799): stdout: | (launched: 2022-12-10_01:28:40.587222) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:28:42.079279 run osmo-stp_10.42.42.5(pid=8799): stderr: | 20221210012840759 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012840760 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012840760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012840760 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012840761 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012840761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012840761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:28:42.208809 run osmo-stp_10.42.42.5(pid=8799): stdout: | (launched: 2022-12-10_01:28:40.587222) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:28:42.333262 run osmo-stp_10.42.42.5(pid=8799): stderr: | 20221210012840759 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012840760 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012840760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012840760 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012840761 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012840761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012840761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:28:42.480924 run patchelf(pid=8802): Terminating (SIGINT) 01:28:42.650060 run patchelf(pid=8802): Terminated: ok {rc=0} 01:28:42.772476 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8799): Process ended prematurely: osmo-stp_10.42.42.5(pid=8799) [trial-2367↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8799)] [trial-2367↪gprs:trx-lms↪iperf3.py:8] 01:28:42.782017 tst iperf3.py:8: Test FAILED (7.5 sec) 01:28:42.809722 run osmo-hlr_10.42.42.2(pid=8796): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8796)] 01:28:42.858308 run osmo-hlr_10.42.42.2(pid=8796): stdout: | (launched: 2022-12-10_01:28:39.627506) 01:28:42.908329 run osmo-hlr_10.42.42.2(pid=8796): stderr: | 20221210012839802 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012839802 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012839802 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012839802 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012839802 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012839802 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012839814 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012839824 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012839824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012839824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:28:42.958755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8791): Terminating (SIGTERM) 01:28:42.999159 run iperf3-srv_10.42.42.10(pid=8792): Terminating (SIGTERM) 01:28:43.039674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8795): Terminating (SIGTERM) 01:28:43.080033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8798): Terminating (SIGTERM) 01:28:43.120396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8801): Terminating (SIGTERM) 01:28:43.161042 --- ParallelTerminationStrategy: PID 8791 died... 01:28:43.180270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8791): Terminated: ok {rc=0} 01:28:43.225289 --- ParallelTerminationStrategy: PID 8792 died... 01:28:43.243945 run iperf3-srv_10.42.42.10(pid=8792): Terminated {rc=256} 01:28:43.288452 --- ParallelTerminationStrategy: PID 8795 died... 01:28:43.307189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8795): Terminated: ok {rc=0} 01:28:43.351685 --- ParallelTerminationStrategy: PID 8798 died... 01:28:43.370437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8798): Terminated: ok {rc=0} 01:28:43.414867 --- ParallelTerminationStrategy: PID 8801 died... 01:28:43.433638 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8801): Terminated: ok {rc=0} 01:28:43.520114 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-lms iperf3m4.py ---------------------------------------------- 01:28:44.666370 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:44.677878 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 01:28:44.728693 tst iperf3m4.py: using LAC 25039 01:28:44.859623 tst iperf3m4.py: using RAC 49 01:28:44.986896 tst iperf3m4.py: using CellId 25039 01:28:45.104799 tst iperf3m4.py: using BVCI 25040 01:28:45.214240 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:45.224816 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:45.235407 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:45.246182 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:45.256774 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:45.267572 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:45.278458 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:45.288988 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:45.299645 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 01:28:45.418693 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 01:28:45.540756 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 01:28:45.656744 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 01:28:45.777062 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:28:45.999456 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:28:46.325745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8803): Launched 01:28:46.607859 run iperf3-srv_10.42.42.10(pid=8804): Launched 01:28:46.747068 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:28:46.969445 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:28:47.301365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8805): Launched 01:28:47.582555 run iperf3-srv_10.42.42.10(pid=8806): Launched 01:28:47.706314 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:28:47.923916 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:28:48.247623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8807): Launched 01:28:48.527881 run iperf3-srv_10.42.42.10(pid=8808): Launched 01:28:48.649510 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:28:48.866412 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:28:49.189847 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8809): Launched 01:28:49.473371 run iperf3-srv_10.42.42.10(pid=8810): Launched 01:28:49.595777 tst iperf3m4.py:8: start network... 01:28:49.812151 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:28:50.314030 run create_hlr_db(pid=8811): Launched 01:28:50.446947 bus /gobi_6: Setting Powered False 01:28:51.510432 run create_hlr_db(pid=8811): Terminated: ok {rc=0} 01:28:51.941944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8813): Launched 01:28:52.244676 run osmo-hlr_10.42.42.2(pid=8814): Launched 01:28:52.361385 run osmo-stp_10.42.42.5: Starting osmo-stp 01:28:52.898235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8816): Launched 01:28:53.201444 run osmo-stp_10.42.42.5(pid=8817): Launched 01:28:53.317647 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:28:53.839606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8819): Launched 01:28:53.955228 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:28:54.209181 run patchelf(pid=8820): Launched 01:28:54.377625 run osmo-stp_10.42.42.5(pid=8817): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8817)] 01:28:54.504813 run osmo-stp_10.42.42.5(pid=8817): stdout: | (launched: 2022-12-10_01:28:53.146014) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:28:54.633664 run osmo-stp_10.42.42.5(pid=8817): stderr: | 20221210012853316 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012853317 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012853317 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012853317 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012853318 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012853318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012853318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:28:54.762301 run osmo-stp_10.42.42.5(pid=8817): stdout: | (launched: 2022-12-10_01:28:53.146014) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:28:54.886189 run osmo-stp_10.42.42.5(pid=8817): stderr: | 20221210012853316 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012853317 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012853317 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012853317 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012853318 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012853318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012853318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:28:55.032119 run patchelf(pid=8820): Terminating (SIGINT) 01:28:55.200805 run patchelf(pid=8820): Terminated: ok {rc=0} 01:28:55.322228 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8817): Process ended prematurely: osmo-stp_10.42.42.5(pid=8817) [trial-2367↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8817)] [trial-2367↪gprs:trx-lms↪iperf3m4.py:8] 01:28:55.331664 tst iperf3m4.py:8: Test FAILED (10.7 sec) 01:28:55.359400 run osmo-hlr_10.42.42.2(pid=8814): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8814)] 01:28:55.407343 run osmo-hlr_10.42.42.2(pid=8814): stdout: | (launched: 2022-12-10_01:28:52.188915) 01:28:55.456554 run osmo-hlr_10.42.42.2(pid=8814): stderr: | 20221210012852367 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012852367 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012852367 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012852367 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012852367 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012852368 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012852380 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012852389 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012852389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012852389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:28:55.506549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8803): Terminating (SIGTERM) 01:28:55.546237 run iperf3-srv_10.42.42.10(pid=8804): Terminating (SIGTERM) 01:28:55.585787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8805): Terminating (SIGTERM) 01:28:55.625448 run iperf3-srv_10.42.42.10(pid=8806): Terminating (SIGTERM) 01:28:55.665043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8807): Terminating (SIGTERM) 01:28:55.704725 run iperf3-srv_10.42.42.10(pid=8808): Terminating (SIGTERM) 01:28:55.744097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8809): Terminating (SIGTERM) 01:28:55.783575 run iperf3-srv_10.42.42.10(pid=8810): Terminating (SIGTERM) 01:28:55.822895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8813): Terminating (SIGTERM) 01:28:55.862523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8816): Terminating (SIGTERM) 01:28:55.902283 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8819): Terminating (SIGTERM) 01:28:55.941974 --- ParallelTerminationStrategy: PID 8803 died... 01:28:55.960688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8803): Terminated: ok {rc=0} 01:28:56.004563 --- ParallelTerminationStrategy: PID 8804 died... 01:28:56.022912 run iperf3-srv_10.42.42.10(pid=8804): Terminated {rc=256} 01:28:56.066404 --- ParallelTerminationStrategy: PID 8805 died... 01:28:56.085140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8805): Terminated: ok {rc=0} 01:28:56.128797 --- ParallelTerminationStrategy: PID 8806 died... 01:28:56.147788 run iperf3-srv_10.42.42.10(pid=8806): Terminated {rc=256} 01:28:56.191310 --- ParallelTerminationStrategy: PID 8807 died... 01:28:56.209674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8807): Terminated: ok {rc=0} 01:28:56.253657 --- ParallelTerminationStrategy: PID 8808 died... 01:28:56.272047 run iperf3-srv_10.42.42.10(pid=8808): Terminated {rc=256} 01:28:56.315554 --- ParallelTerminationStrategy: PID 8809 died... 01:28:56.333941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8809): Terminated: ok {rc=0} 01:28:56.377618 --- ParallelTerminationStrategy: PID 8810 died... 01:28:56.396067 run iperf3-srv_10.42.42.10(pid=8810): Terminated {rc=256} 01:28:56.439666 --- ParallelTerminationStrategy: PID 8813 died... 01:28:56.458128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8813): Terminated: ok {rc=0} 01:28:56.501920 --- ParallelTerminationStrategy: PID 8816 died... 01:28:56.520556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8816): Terminated: ok {rc=0} 01:28:56.564382 --- ParallelTerminationStrategy: PID 8819 died... 01:28:56.582917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8819): Terminated: ok {rc=0} 01:28:56.668684 bus /gobi_4: Setting Powered False 01:28:57.767939 bus /gobi_4: Setting Powered False 01:28:58.881253 bus /gobi_1: Setting Powered False 01:28:59.977079 bus /gobi_1: Setting Powered False 01:29:01.102758 bus /gobi_0: Setting Powered False 01:29:02.203459 bus /gobi_0: Setting Powered False 01:29:03.321512 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-lms ping.py ---------------------------------------------- 01:29:04.424314 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:04.435749 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 01:29:04.485457 tst ping.py: using LAC 25040 01:29:04.602606 tst ping.py: using RAC 50 01:29:04.717993 tst ping.py: using CellId 25040 01:29:04.832802 tst ping.py: using BVCI 25041 01:29:04.939427 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:04.950048 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:04.960282 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:04.970761 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:04.981258 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:04.991700 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:05.002429 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:05.013403 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 01:29:05.132054 tst ping.py:19: start network... 01:29:05.346249 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:29:05.835938 run create_hlr_db(pid=8821): Launched 01:29:05.966109 bus /gobi_6: Setting Powered False 01:29:07.028813 run create_hlr_db(pid=8821): Terminated: ok {rc=0} 01:29:07.452327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8823): Launched 01:29:07.770664 run osmo-hlr_10.42.42.2(pid=8824): Launched 01:29:07.892413 run osmo-stp_10.42.42.5: Starting osmo-stp 01:29:08.442214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8826): Launched 01:29:08.761021 run osmo-stp_10.42.42.5(pid=8827): Launched 01:29:08.882416 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:29:09.428031 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8829): Launched 01:29:09.549178 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:29:09.816031 run patchelf(pid=8830): Launched 01:29:09.993612 run osmo-stp_10.42.42.5(pid=8827): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8827)] 01:29:10.127557 run osmo-stp_10.42.42.5(pid=8827): stdout: | (launched: 2022-12-10_01:29:08.703086) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:29:10.263223 run osmo-stp_10.42.42.5(pid=8827): stderr: | 20221210012908895 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012908895 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012908895 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012908896 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012908898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012908898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012908898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:29:10.398476 run osmo-stp_10.42.42.5(pid=8827): stdout: | (launched: 2022-12-10_01:29:08.703086) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:29:10.528648 run osmo-stp_10.42.42.5(pid=8827): stderr: | 20221210012908895 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012908895 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012908895 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012908896 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012908898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012908898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012908898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:29:10.682846 run patchelf(pid=8830): Terminating (SIGINT) 01:29:10.859244 run patchelf(pid=8830): Terminated: ok {rc=0} 01:29:10.987062 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8827): Process ended prematurely: osmo-stp_10.42.42.5(pid=8827) [trial-2367↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8827)] [trial-2367↪gprs:trx-lms↪ping.py:22] 01:29:10.996524 tst ping.py:22: Test FAILED (6.6 sec) 01:29:11.024789 run osmo-hlr_10.42.42.2(pid=8824): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8824)] 01:29:11.074603 run osmo-hlr_10.42.42.2(pid=8824): stdout: | (launched: 2022-12-10_01:29:07.712864) 01:29:11.126209 run osmo-hlr_10.42.42.2(pid=8824): stderr: | 20221210012907913 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012907913 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012907913 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012907913 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012907914 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012907914 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012907927 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012907937 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012907938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012907938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:29:11.178361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8823): Terminating (SIGTERM) 01:29:11.219954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8826): Terminating (SIGTERM) 01:29:11.262009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8829): Terminating (SIGTERM) 01:29:11.303981 --- ParallelTerminationStrategy: PID 8823 died... 01:29:11.324053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8823): Terminated: ok {rc=0} 01:29:11.370154 --- ParallelTerminationStrategy: PID 8826 died... 01:29:11.389514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8826): Terminated: ok {rc=0} 01:29:11.435138 --- ParallelTerminationStrategy: PID 8829 died... 01:29:11.454659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8829): Terminated: ok {rc=0} 01:29:11.542002 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 01:29:12.631413 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:12.643579 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 01:29:12.695809 tst ping_idle_ping.py: using LAC 25041 01:29:12.822747 tst ping_idle_ping.py: using RAC 51 01:29:12.949312 tst ping_idle_ping.py: using CellId 25041 01:29:13.073777 tst ping_idle_ping.py: using BVCI 25042 01:29:13.189016 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:13.200006 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:13.210951 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:13.221840 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:13.232626 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:13.243503 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:13.254450 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:13.265591 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 01:29:13.379788 tst ping_idle_ping.py:24: start network... 01:29:13.578875 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:29:14.041976 run create_hlr_db(pid=8831): Launched 01:29:14.157207 bus /gobi_6: Setting Powered False 01:29:15.217164 run create_hlr_db(pid=8831): Terminated: ok {rc=0} 01:29:15.632806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8833): Launched 01:29:15.950794 run osmo-hlr_10.42.42.2(pid=8834): Launched 01:29:16.185593 run osmo-stp_10.42.42.5: Starting osmo-stp 01:29:16.859338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8836): Launched 01:29:17.171898 run osmo-stp_10.42.42.5(pid=8837): Launched 01:29:17.328441 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:29:17.867131 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8839): Launched 01:29:17.982119 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:29:18.234218 run patchelf(pid=8840): Launched 01:29:18.402191 run osmo-stp_10.42.42.5(pid=8837): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8837)] 01:29:18.527948 run osmo-stp_10.42.42.5(pid=8837): stdout: | (launched: 2022-12-10_01:29:17.116560) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:29:18.655419 run osmo-stp_10.42.42.5(pid=8837): stderr: | 20221210012917390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012917390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012917390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012917390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012917391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012917391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012917391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:29:18.783339 run osmo-stp_10.42.42.5(pid=8837): stdout: | (launched: 2022-12-10_01:29:17.116560) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:29:18.906190 run osmo-stp_10.42.42.5(pid=8837): stderr: | 20221210012917390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012917390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012917390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012917390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012917391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012917391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012917391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:29:19.051319 run patchelf(pid=8840): Terminating (SIGINT) 01:29:19.218279 run patchelf(pid=8840): Terminated: ok {rc=0} 01:29:19.338732 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8837): Process ended prematurely: osmo-stp_10.42.42.5(pid=8837) [trial-2367↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8837)] [trial-2367↪gprs:trx-lms↪ping_idle_ping.py:27] 01:29:19.347780 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 01:29:19.375286 run osmo-hlr_10.42.42.2(pid=8834): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8834)] 01:29:19.423315 run osmo-hlr_10.42.42.2(pid=8834): stdout: | (launched: 2022-12-10_01:29:15.883668) 01:29:19.473210 run osmo-hlr_10.42.42.2(pid=8834): stderr: | 20221210012916244 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012916244 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012916244 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012916244 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012916244 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012916244 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012916272 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012916290 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012916290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012916290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:29:19.523079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8833): Terminating (SIGTERM) 01:29:19.563421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8836): Terminating (SIGTERM) 01:29:19.603799 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8839): Terminating (SIGTERM) 01:29:19.644238 --- ParallelTerminationStrategy: PID 8833 died... 01:29:19.663462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8833): Terminated: ok {rc=0} 01:29:19.708008 --- ParallelTerminationStrategy: PID 8836 died... 01:29:19.726738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8836): Terminated: ok {rc=0} 01:29:19.771458 --- ParallelTerminationStrategy: PID 8839 died... 01:29:19.790196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8839): Terminated: ok {rc=0} 01:29:19.876210 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 01:29:21.179238 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:29:21.186364 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 01:29:21.221336 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 01:29:21.261097 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 01:29:21.349213 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 01:29:21.383663 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 01:29:21.423466 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 01:29:22.013871 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 01:29:22.064134 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:22.075142 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:29:22.124301 tst cs_paging_gprs_active.py: using LAC 25042 01:29:22.241859 tst cs_paging_gprs_active.py: using RAC 52 01:29:22.361636 tst cs_paging_gprs_active.py: using CellId 25042 01:29:22.488098 tst cs_paging_gprs_active.py: using BVCI 25043 01:29:22.606565 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:22.617927 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:22.628923 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:22.640433 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:22.651452 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:22.662547 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:22.674270 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:22.685246 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:22.696369 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:29:22.817367 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:29:22.933903 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:29:23.138416 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:29:23.443105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8844): Launched 01:29:23.707907 run iperf3-srv_10.42.42.10(pid=8845): Launched 01:29:23.822443 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:29:24.025869 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:29:24.330493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8846): Launched 01:29:24.596750 run iperf3-srv_10.42.42.10(pid=8847): Launched 01:29:24.711204 tst cs_paging_gprs_active.py:38: start network... 01:29:24.915074 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:29:25.386854 run create_hlr_db(pid=8848): Launched 01:29:25.505873 bus /gobi_6: Setting Powered False 01:29:26.566197 run create_hlr_db(pid=8848): Terminated: ok {rc=0} 01:29:26.987967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8850): Launched 01:29:27.291796 run osmo-hlr_10.42.42.2(pid=8851): Launched 01:29:27.408139 run osmo-stp_10.42.42.5: Starting osmo-stp 01:29:27.944669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8853): Launched 01:29:28.246949 run osmo-stp_10.42.42.5(pid=8854): Launched 01:29:28.362957 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:29:28.883554 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8856): Launched 01:29:28.999404 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:29:29.255478 run patchelf(pid=8857): Launched 01:29:29.426170 run osmo-stp_10.42.42.5(pid=8854): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8854)] 01:29:29.554337 run osmo-stp_10.42.42.5(pid=8854): stdout: | (launched: 2022-12-10_01:29:28.191346) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:29:29.683564 run osmo-stp_10.42.42.5(pid=8854): stderr: | 20221210012928363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012928363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012928363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012928364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012928364 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012928364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012928364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:29:29.812828 run osmo-stp_10.42.42.5(pid=8854): stdout: | (launched: 2022-12-10_01:29:28.191346) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:29:29.936502 run osmo-stp_10.42.42.5(pid=8854): stderr: | 20221210012928363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012928363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012928363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012928364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012928364 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012928364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012928364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:29:30.083211 run patchelf(pid=8857): Terminating (SIGINT) 01:29:30.252738 run patchelf(pid=8857): Terminated: ok {rc=0} 01:29:30.374947 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8854): Process ended prematurely: osmo-stp_10.42.42.5(pid=8854) [trial-2367↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8854)] [trial-2367↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 01:29:30.384354 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 01:29:30.412164 run osmo-hlr_10.42.42.2(pid=8851): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8851)] 01:29:30.460145 run osmo-hlr_10.42.42.2(pid=8851): stdout: | (launched: 2022-12-10_01:29:27.235923) 01:29:30.509765 run osmo-hlr_10.42.42.2(pid=8851): stderr: | 20221210012927411 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012927411 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012927411 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012927412 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012927412 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012927412 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012927427 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012927436 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012927437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012927437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:29:30.559803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8844): Terminating (SIGTERM) 01:29:30.599720 run iperf3-srv_10.42.42.10(pid=8845): Terminating (SIGTERM) 01:29:30.639436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8846): Terminating (SIGTERM) 01:29:30.679213 run iperf3-srv_10.42.42.10(pid=8847): Terminating (SIGTERM) 01:29:30.718915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8850): Terminating (SIGTERM) 01:29:30.758795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8853): Terminating (SIGTERM) 01:29:30.798622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8856): Terminating (SIGTERM) 01:29:30.839522 --- ParallelTerminationStrategy: PID 8844 died... 01:29:30.859095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8844): Terminated: ok {rc=0} 01:29:30.905626 --- ParallelTerminationStrategy: PID 8845 died... 01:29:30.924863 run iperf3-srv_10.42.42.10(pid=8845): Terminated {rc=256} 01:29:30.971443 --- ParallelTerminationStrategy: PID 8846 died... 01:29:30.991137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8846): Terminated: ok {rc=0} 01:29:31.037509 --- ParallelTerminationStrategy: PID 8847 died... 01:29:31.057063 run iperf3-srv_10.42.42.10(pid=8847): Terminated {rc=256} 01:29:31.103824 --- ParallelTerminationStrategy: PID 8850 died... 01:29:31.123631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8850): Terminated: ok {rc=0} 01:29:31.171142 --- ParallelTerminationStrategy: PID 8853 died... 01:29:31.190965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8853): Terminated: ok {rc=0} 01:29:31.238259 --- ParallelTerminationStrategy: PID 8856 died... 01:29:31.258040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8856): Terminated: ok {rc=0} 01:29:31.346724 bus /gobi_0: Setting Powered False 01:29:32.443665 bus /gobi_0: Setting Powered False 01:29:33.559221 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 01:29:34.705787 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:34.717524 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:29:34.767332 tst iperf3.py: using LAC 25043 01:29:34.887471 tst iperf3.py: using RAC 53 01:29:35.005914 tst iperf3.py: using CellId 25043 01:29:35.127539 tst iperf3.py: using BVCI 25044 01:29:35.247028 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:35.258782 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:35.270089 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:35.281534 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:35.292734 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:35.304161 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:35.315541 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:35.326590 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:35.337858 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:29:35.458561 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:29:35.662256 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:29:35.965425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8858): Launched 01:29:36.229729 run iperf3-srv_10.42.42.10(pid=8859): Launched 01:29:36.344169 tst iperf3.py:8: start network... 01:29:36.546965 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:29:37.014510 run create_hlr_db(pid=8860): Launched 01:29:37.132081 bus /gobi_6: Setting Powered False 01:29:38.191814 run create_hlr_db(pid=8860): Terminated: ok {rc=0} 01:29:38.611392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8862): Launched 01:29:38.913748 run osmo-hlr_10.42.42.2(pid=8863): Launched 01:29:39.030878 run osmo-stp_10.42.42.5: Starting osmo-stp 01:29:39.553406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8865): Launched 01:29:39.855803 run osmo-stp_10.42.42.5(pid=8866): Launched 01:29:39.972839 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:29:40.492863 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8868): Launched 01:29:40.608396 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:29:40.863897 run patchelf(pid=8869): Launched 01:29:41.032194 run osmo-stp_10.42.42.5(pid=8866): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8866)] 01:29:41.160218 run osmo-stp_10.42.42.5(pid=8866): stdout: | (launched: 2022-12-10_01:29:39.800290) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:29:41.289663 run osmo-stp_10.42.42.5(pid=8866): stderr: | 20221210012939973 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012939974 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012939974 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012939974 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012939975 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012939975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012939975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:29:41.419670 run osmo-stp_10.42.42.5(pid=8866): stdout: | (launched: 2022-12-10_01:29:39.800290) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:29:41.544361 run osmo-stp_10.42.42.5(pid=8866): stderr: | 20221210012939973 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012939974 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012939974 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012939974 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012939975 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012939975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012939975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:29:41.691256 run patchelf(pid=8869): Terminating (SIGINT) 01:29:41.860059 run patchelf(pid=8869): Terminated: ok {rc=0} 01:29:41.982677 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8866): Process ended prematurely: osmo-stp_10.42.42.5(pid=8866) [trial-2367↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8866)] [trial-2367↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 01:29:41.992084 tst iperf3.py:8: Test FAILED (7.3 sec) 01:29:42.019671 run osmo-hlr_10.42.42.2(pid=8863): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8863)] 01:29:42.067426 run osmo-hlr_10.42.42.2(pid=8863): stdout: | (launched: 2022-12-10_01:29:38.858301) 01:29:42.116917 run osmo-hlr_10.42.42.2(pid=8863): stderr: | 20221210012939035 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012939035 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012939035 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012939035 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012939035 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012939035 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012939047 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012939056 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012939056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012939056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:29:42.167037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8858): Terminating (SIGTERM) 01:29:42.207065 run iperf3-srv_10.42.42.10(pid=8859): Terminating (SIGTERM) 01:29:42.246932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8862): Terminating (SIGTERM) 01:29:42.286927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8865): Terminating (SIGTERM) 01:29:42.327519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8868): Terminating (SIGTERM) 01:29:42.367759 --- ParallelTerminationStrategy: PID 8858 died... 01:29:42.386957 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8858): Terminated: ok {rc=0} 01:29:42.431461 --- ParallelTerminationStrategy: PID 8859 died... 01:29:42.450083 run iperf3-srv_10.42.42.10(pid=8859): Terminated {rc=256} 01:29:42.493940 --- ParallelTerminationStrategy: PID 8862 died... 01:29:42.512328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8862): Terminated: ok {rc=0} 01:29:42.556510 --- ParallelTerminationStrategy: PID 8865 died... 01:29:42.574965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8865): Terminated: ok {rc=0} 01:29:42.618690 --- ParallelTerminationStrategy: PID 8868 died... 01:29:42.637081 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8868): Terminated: ok {rc=0} 01:29:42.722631 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 01:29:43.868301 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:43.879954 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:29:43.930705 tst iperf3m4.py: using LAC 25044 01:29:44.052290 tst iperf3m4.py: using RAC 54 01:29:44.168523 tst iperf3m4.py: using CellId 25044 01:29:44.284530 tst iperf3m4.py: using BVCI 25045 01:29:44.393615 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:44.404357 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:44.415039 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:44.425930 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:44.436650 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:44.447581 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:44.458557 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:44.469351 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:44.480249 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:29:44.594398 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:29:44.715770 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:29:44.831134 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:29:44.947014 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:29:45.149529 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:29:45.452912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8870): Launched 01:29:45.717840 run iperf3-srv_10.42.42.10(pid=8871): Launched 01:29:45.836417 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:29:46.049528 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:29:46.381776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8872): Launched 01:29:46.680467 run iperf3-srv_10.42.42.10(pid=8873): Launched 01:29:46.817419 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:29:47.041659 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:29:47.370012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8874): Launched 01:29:47.652085 run iperf3-srv_10.42.42.10(pid=8875): Launched 01:29:47.774441 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:29:47.991910 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:29:48.315082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8876): Launched 01:29:48.597633 run iperf3-srv_10.42.42.10(pid=8877): Launched 01:29:48.721379 tst iperf3m4.py:8: start network... 01:29:48.939757 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:29:49.443932 run create_hlr_db(pid=8878): Launched 01:29:49.577945 bus /gobi_6: Setting Powered False 01:29:50.642022 run create_hlr_db(pid=8878): Terminated: ok {rc=0} 01:29:51.090755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8880): Launched 01:29:51.413999 run osmo-hlr_10.42.42.2(pid=8881): Launched 01:29:51.538154 run osmo-stp_10.42.42.5: Starting osmo-stp 01:29:52.093252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8883): Launched 01:29:52.415096 run osmo-stp_10.42.42.5(pid=8884): Launched 01:29:52.539341 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:29:53.096663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8886): Launched 01:29:53.219529 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:29:53.491491 run patchelf(pid=8887): Launched 01:29:53.673134 run osmo-stp_10.42.42.5(pid=8884): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8884)] 01:29:53.809194 run osmo-stp_10.42.42.5(pid=8884): stdout: | (launched: 2022-12-10_01:29:52.356201) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:29:53.947139 run osmo-stp_10.42.42.5(pid=8884): stderr: | 20221210012952549 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012952549 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012952550 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012952550 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012952551 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012952551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012952551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:29:54.084873 run osmo-stp_10.42.42.5(pid=8884): stdout: | (launched: 2022-12-10_01:29:52.356201) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:29:54.217322 run osmo-stp_10.42.42.5(pid=8884): stderr: | 20221210012952549 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210012952549 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210012952550 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210012952550 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210012952551 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210012952551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210012952551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:29:54.373820 run patchelf(pid=8887): Terminating (SIGINT) 01:29:54.553631 run patchelf(pid=8887): Terminated: ok {rc=0} 01:29:54.683129 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8884): Process ended prematurely: osmo-stp_10.42.42.5(pid=8884) [trial-2367↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8884)] [trial-2367↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 01:29:54.693203 tst iperf3m4.py:8: Test FAILED (10.9 sec) 01:29:54.721696 run osmo-hlr_10.42.42.2(pid=8881): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8881)] 01:29:54.771589 run osmo-hlr_10.42.42.2(pid=8881): stdout: | (launched: 2022-12-10_01:29:51.355040) 01:29:54.823095 run osmo-hlr_10.42.42.2(pid=8881): stderr: | 20221210012951552 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210012951553 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210012951553 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210012951553 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210012951553 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210012951553 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210012951565 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210012951573 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210012951573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210012951573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:29:54.874893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8870): Terminating (SIGTERM) 01:29:54.916453 run iperf3-srv_10.42.42.10(pid=8871): Terminating (SIGTERM) 01:29:54.958265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8872): Terminating (SIGTERM) 01:29:54.999806 run iperf3-srv_10.42.42.10(pid=8873): Terminating (SIGTERM) 01:29:55.042522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8874): Terminating (SIGTERM) 01:29:55.084218 run iperf3-srv_10.42.42.10(pid=8875): Terminating (SIGTERM) 01:29:55.125204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8876): Terminating (SIGTERM) 01:29:55.166519 run iperf3-srv_10.42.42.10(pid=8877): Terminating (SIGTERM) 01:29:55.207731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8880): Terminating (SIGTERM) 01:29:55.249187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8883): Terminating (SIGTERM) 01:29:55.290404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8886): Terminating (SIGTERM) 01:29:55.331919 --- ParallelTerminationStrategy: PID 8870 died... 01:29:55.351836 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8870): Terminated: ok {rc=0} 01:29:55.398062 --- ParallelTerminationStrategy: PID 8871 died... 01:29:55.417373 run iperf3-srv_10.42.42.10(pid=8871): Terminated {rc=256} 01:29:55.462929 --- ParallelTerminationStrategy: PID 8872 died... 01:29:55.482494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8872): Terminated: ok {rc=0} 01:29:55.528018 --- ParallelTerminationStrategy: PID 8873 died... 01:29:55.547404 run iperf3-srv_10.42.42.10(pid=8873): Terminated {rc=256} 01:29:55.593043 --- ParallelTerminationStrategy: PID 8874 died... 01:29:55.613123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8874): Terminated: ok {rc=0} 01:29:55.659211 --- ParallelTerminationStrategy: PID 8875 died... 01:29:55.678736 run iperf3-srv_10.42.42.10(pid=8875): Terminated {rc=256} 01:29:55.724201 --- ParallelTerminationStrategy: PID 8876 died... 01:29:55.743620 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8876): Terminated: ok {rc=0} 01:29:55.789195 --- ParallelTerminationStrategy: PID 8877 died... 01:29:55.808601 run iperf3-srv_10.42.42.10(pid=8877): Terminated {rc=256} 01:29:55.854051 --- ParallelTerminationStrategy: PID 8880 died... 01:29:55.873535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8880): Terminated: ok {rc=0} 01:29:55.919225 --- ParallelTerminationStrategy: PID 8883 died... 01:29:55.939035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8883): Terminated: ok {rc=0} 01:29:55.984904 --- ParallelTerminationStrategy: PID 8886 died... 01:29:56.004417 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8886): Terminated: ok {rc=0} 01:29:56.091125 bus /gobi_4: Setting Powered False 01:29:57.189064 bus /gobi_4: Setting Powered False 01:29:58.305988 bus /gobi_1: Setting Powered False 01:29:59.404317 bus /gobi_1: Setting Powered False 01:30:00.519646 bus /gobi_0: Setting Powered False 01:30:01.622843 bus /gobi_0: Setting Powered False 01:30:02.744040 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 01:30:03.847776 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:03.859948 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:30:03.911906 tst ping.py: using LAC 25045 01:30:04.036721 tst ping.py: using RAC 55 01:30:04.160484 tst ping.py: using CellId 25045 01:30:04.285236 tst ping.py: using BVCI 25046 01:30:04.401558 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:04.413043 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:04.424111 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:04.435259 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:04.446472 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:04.457567 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:04.468773 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:04.479792 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:30:04.595065 tst ping.py:19: start network... 01:30:04.791764 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:30:05.249274 run create_hlr_db(pid=8891): Launched 01:30:05.363472 bus /gobi_6: Setting Powered False 01:30:06.422731 run create_hlr_db(pid=8891): Terminated: ok {rc=0} 01:30:06.854246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8893): Launched 01:30:07.172720 run osmo-hlr_10.42.42.2(pid=8894): Launched 01:30:07.295365 run osmo-stp_10.42.42.5: Starting osmo-stp 01:30:07.849365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8896): Launched 01:30:08.169772 run osmo-stp_10.42.42.5(pid=8897): Launched 01:30:08.293012 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:30:08.842509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8899): Launched 01:30:08.964527 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:30:09.233267 run patchelf(pid=8900): Launched 01:30:09.411375 run osmo-stp_10.42.42.5(pid=8897): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8897)] 01:30:09.544907 run osmo-stp_10.42.42.5(pid=8897): stdout: | (launched: 2022-12-10_01:30:08.111330) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:30:09.680385 run osmo-stp_10.42.42.5(pid=8897): stderr: | 20221210013008303 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013008303 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013008304 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013008304 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013008307 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013008307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013008307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:30:09.815877 run osmo-stp_10.42.42.5(pid=8897): stdout: | (launched: 2022-12-10_01:30:08.111330) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:30:09.946392 run osmo-stp_10.42.42.5(pid=8897): stderr: | 20221210013008303 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013008303 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013008304 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013008304 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013008307 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013008307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013008307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:30:10.100673 run patchelf(pid=8900): Terminating (SIGINT) 01:30:10.277104 run patchelf(pid=8900): Terminated: ok {rc=0} 01:30:10.404269 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8897): Process ended prematurely: osmo-stp_10.42.42.5(pid=8897) [trial-2367↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8897)] [trial-2367↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 01:30:10.413968 tst ping.py:22: Test FAILED (6.6 sec) 01:30:10.442196 run osmo-hlr_10.42.42.2(pid=8894): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8894)] 01:30:10.491821 run osmo-hlr_10.42.42.2(pid=8894): stdout: | (launched: 2022-12-10_01:30:07.114665) 01:30:10.543363 run osmo-hlr_10.42.42.2(pid=8894): stderr: | 20221210013007313 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013007313 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013007313 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013007313 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013007313 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013007313 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013007325 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013007334 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013007334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013007334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:30:10.595418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8893): Terminating (SIGTERM) 01:30:10.637126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8896): Terminating (SIGTERM) 01:30:10.678941 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8899): Terminating (SIGTERM) 01:30:10.721088 --- ParallelTerminationStrategy: PID 8893 died... 01:30:10.741095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8893): Terminated: ok {rc=0} 01:30:10.786974 --- ParallelTerminationStrategy: PID 8896 died... 01:30:10.806449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8896): Terminated: ok {rc=0} 01:30:10.852055 --- ParallelTerminationStrategy: PID 8899 died... 01:30:10.871345 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8899): Terminated: ok {rc=0} 01:30:10.958005 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 01:30:12.045658 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:12.057902 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:30:12.110982 tst ping_idle_ping.py: using LAC 25046 01:30:12.237708 tst ping_idle_ping.py: using RAC 56 01:30:12.362271 tst ping_idle_ping.py: using CellId 25046 01:30:12.488111 tst ping_idle_ping.py: using BVCI 25047 01:30:12.604502 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:12.615803 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:12.627002 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:12.638093 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:12.649066 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:12.660047 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:12.671265 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:12.682347 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:30:12.799265 tst ping_idle_ping.py:24: start network... 01:30:13.013061 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:30:13.505724 run create_hlr_db(pid=8901): Launched 01:30:13.638059 bus /gobi_6: Setting Powered False 01:30:14.701314 run create_hlr_db(pid=8901): Terminated: ok {rc=0} 01:30:15.126440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8903): Launched 01:30:15.424928 run osmo-hlr_10.42.42.2(pid=8904): Launched 01:30:15.539394 run osmo-stp_10.42.42.5: Starting osmo-stp 01:30:16.079503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8906): Launched 01:30:16.436786 run osmo-stp_10.42.42.5(pid=8907): Launched 01:30:16.598190 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:30:17.411615 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8909): Launched 01:30:17.534333 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:30:17.802691 run patchelf(pid=8910): Launched 01:30:17.982090 run osmo-stp_10.42.42.5(pid=8907): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8907)] 01:30:18.116776 run osmo-stp_10.42.42.5(pid=8907): stdout: | (launched: 2022-12-10_01:30:16.378437) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:30:18.252444 run osmo-stp_10.42.42.5(pid=8907): stderr: | 20221210013016752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013016752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013016752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013016752 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013016753 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013016753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013016753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:30:18.388414 run osmo-stp_10.42.42.5(pid=8907): stdout: | (launched: 2022-12-10_01:30:16.378437) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:30:18.519180 run osmo-stp_10.42.42.5(pid=8907): stderr: | 20221210013016752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013016752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013016752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013016752 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013016753 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013016753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013016753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:30:18.674318 run patchelf(pid=8910): Terminating (SIGINT) 01:30:18.851493 run patchelf(pid=8910): Terminated: ok {rc=0} 01:30:18.979370 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8907): Process ended prematurely: osmo-stp_10.42.42.5(pid=8907) [trial-2367↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8907)] [trial-2367↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 01:30:18.988830 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 01:30:19.017241 run osmo-hlr_10.42.42.2(pid=8904): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8904)] 01:30:19.066865 run osmo-hlr_10.42.42.2(pid=8904): stdout: | (launched: 2022-12-10_01:30:15.370147) 01:30:19.118211 run osmo-hlr_10.42.42.2(pid=8904): stderr: | 20221210013015545 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013015545 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013015545 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013015545 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013015545 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013015545 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013015558 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013015567 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013015567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013015567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:30:19.170068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8903): Terminating (SIGTERM) 01:30:19.211557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8906): Terminating (SIGTERM) 01:30:19.253207 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8909): Terminating (SIGTERM) 01:30:19.295084 --- ParallelTerminationStrategy: PID 8903 died... 01:30:19.315244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8903): Terminated: ok {rc=0} 01:30:19.360883 --- ParallelTerminationStrategy: PID 8906 died... 01:30:19.380374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8906): Terminated: ok {rc=0} 01:30:19.426598 --- ParallelTerminationStrategy: PID 8909 died... 01:30:19.446028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8909): Terminated: ok {rc=0} 01:30:19.534133 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 01:30:20.829542 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:30:20.835564 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 01:30:20.870452 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 01:30:20.908812 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 01:30:20.995198 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 01:30:21.028534 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 01:30:21.067221 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 01:30:21.667565 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 01:30:21.721084 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:21.732516 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:30:21.815746 tst cs_paging_gprs_active.py: using LAC 25047 01:30:21.944589 tst cs_paging_gprs_active.py: using RAC 57 01:30:22.074387 tst cs_paging_gprs_active.py: using CellId 25047 01:30:22.202736 tst cs_paging_gprs_active.py: using BVCI 25048 01:30:22.321801 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:22.333079 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:22.344346 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:22.355568 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:22.366653 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:22.377807 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:22.388935 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:22.399930 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:22.411195 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:30:22.529318 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:30:22.645211 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:30:22.847712 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:30:23.151605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8914): Launched 01:30:23.417553 run iperf3-srv_10.42.42.10(pid=8915): Launched 01:30:23.531572 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:30:23.734077 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:30:24.039325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8916): Launched 01:30:24.303019 run iperf3-srv_10.42.42.10(pid=8917): Launched 01:30:24.417097 tst cs_paging_gprs_active.py:38: start network... 01:30:24.619546 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:30:25.087538 run create_hlr_db(pid=8918): Launched 01:30:25.205258 bus /gobi_6: Setting Powered False 01:30:26.265499 run create_hlr_db(pid=8918): Terminated: ok {rc=0} 01:30:26.686150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8920): Launched 01:30:26.990134 run osmo-hlr_10.42.42.2(pid=8921): Launched 01:30:27.106305 run osmo-stp_10.42.42.5: Starting osmo-stp 01:30:27.638776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8923): Launched 01:30:27.943261 run osmo-stp_10.42.42.5(pid=8924): Launched 01:30:28.059034 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:30:28.580240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8926): Launched 01:30:28.696847 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:30:28.959833 run patchelf(pid=8927): Launched 01:30:29.128736 run osmo-stp_10.42.42.5(pid=8924): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8924)] 01:30:29.256894 run osmo-stp_10.42.42.5(pid=8924): stdout: | (launched: 2022-12-10_01:30:27.887575) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:30:29.386412 run osmo-stp_10.42.42.5(pid=8924): stderr: | 20221210013028059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013028059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013028060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013028060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013028061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013028061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013028061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:30:29.516190 run osmo-stp_10.42.42.5(pid=8924): stdout: | (launched: 2022-12-10_01:30:27.887575) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:30:29.640554 run osmo-stp_10.42.42.5(pid=8924): stderr: | 20221210013028059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013028059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013028060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013028060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013028061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013028061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013028061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:30:29.787653 run patchelf(pid=8927): Terminating (SIGINT) 01:30:29.958073 run patchelf(pid=8927): Terminated: ok {rc=0} 01:30:30.080898 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8924): Process ended prematurely: osmo-stp_10.42.42.5(pid=8924) [trial-2367↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8924)] [trial-2367↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 01:30:30.090617 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 01:30:30.118330 run osmo-hlr_10.42.42.2(pid=8921): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8921)] 01:30:30.165631 run osmo-hlr_10.42.42.2(pid=8921): stdout: | (launched: 2022-12-10_01:30:26.934659) 01:30:30.214712 run osmo-hlr_10.42.42.2(pid=8921): stderr: | 20221210013027112 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013027112 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013027112 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013027112 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013027112 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013027113 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013027125 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013027133 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013027134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013027134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:30:30.264159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8914): Terminating (SIGTERM) 01:30:30.303812 run iperf3-srv_10.42.42.10(pid=8915): Terminating (SIGTERM) 01:30:30.343455 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8916): Terminating (SIGTERM) 01:30:30.382964 run iperf3-srv_10.42.42.10(pid=8917): Terminating (SIGTERM) 01:30:30.422305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8920): Terminating (SIGTERM) 01:30:30.461819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8923): Terminating (SIGTERM) 01:30:30.501285 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8926): Terminating (SIGTERM) 01:30:30.541015 --- ParallelTerminationStrategy: PID 8914 died... 01:30:30.560105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8914): Terminated: ok {rc=0} 01:30:30.604557 --- ParallelTerminationStrategy: PID 8915 died... 01:30:30.623066 run iperf3-srv_10.42.42.10(pid=8915): Terminated {rc=256} 01:30:30.666794 --- ParallelTerminationStrategy: PID 8916 died... 01:30:30.685227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8916): Terminated: ok {rc=0} 01:30:30.729153 --- ParallelTerminationStrategy: PID 8917 died... 01:30:30.747579 run iperf3-srv_10.42.42.10(pid=8917): Terminated {rc=256} 01:30:30.791790 --- ParallelTerminationStrategy: PID 8920 died... 01:30:30.810246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8920): Terminated: ok {rc=0} 01:30:30.862468 --- ParallelTerminationStrategy: PID 8923 died... 01:30:30.881538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8923): Terminated: ok {rc=0} 01:30:30.926339 --- ParallelTerminationStrategy: PID 8926 died... 01:30:30.945360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8926): Terminated: ok {rc=0} 01:30:31.032720 bus /gobi_0: Setting Powered False 01:30:32.146607 bus /gobi_0: Setting Powered False 01:30:33.263492 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 01:30:34.412163 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:34.424472 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:30:34.497318 tst iperf3.py: using LAC 25048 01:30:34.625173 tst iperf3.py: using RAC 58 01:30:34.757785 tst iperf3.py: using CellId 25048 01:30:34.882932 tst iperf3.py: using BVCI 25049 01:30:35.001080 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:35.012570 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:35.023752 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:35.035051 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:35.046396 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:35.057654 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:35.069095 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:35.080022 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:35.091387 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:30:35.209827 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:30:35.427518 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:30:35.749705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8928): Launched 01:30:36.033110 run iperf3-srv_10.42.42.10(pid=8929): Launched 01:30:36.154801 tst iperf3.py:8: start network... 01:30:36.371806 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:30:36.871900 run create_hlr_db(pid=8930): Launched 01:30:37.003488 bus /gobi_6: Setting Powered False 01:30:38.067448 run create_hlr_db(pid=8930): Terminated: ok {rc=0} 01:30:38.514002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8932): Launched 01:30:38.837640 run osmo-hlr_10.42.42.2(pid=8933): Launched 01:30:38.963623 run osmo-stp_10.42.42.5: Starting osmo-stp 01:30:39.522555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8935): Launched 01:30:39.845971 run osmo-stp_10.42.42.5(pid=8936): Launched 01:30:39.971632 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:30:40.535473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8938): Launched 01:30:40.659355 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:30:40.931872 run patchelf(pid=8939): Launched 01:30:41.112263 run osmo-stp_10.42.42.5(pid=8936): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8936)] 01:30:41.248070 run osmo-stp_10.42.42.5(pid=8936): stdout: | (launched: 2022-12-10_01:30:39.786631) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:30:41.385510 run osmo-stp_10.42.42.5(pid=8936): stderr: | 20221210013039981 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013039981 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013039981 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013039982 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013039982 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013039982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013039982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:30:41.523453 run osmo-stp_10.42.42.5(pid=8936): stdout: | (launched: 2022-12-10_01:30:39.786631) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:30:41.655384 run osmo-stp_10.42.42.5(pid=8936): stderr: | 20221210013039981 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013039981 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013039981 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013039982 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013039982 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013039982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013039982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:30:41.811869 run patchelf(pid=8939): Terminating (SIGINT) 01:30:41.992580 run patchelf(pid=8939): Terminated: ok {rc=0} 01:30:42.122465 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8936): Process ended prematurely: osmo-stp_10.42.42.5(pid=8936) [trial-2367↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8936)] [trial-2367↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 01:30:42.132515 tst iperf3.py:8: Test FAILED (7.8 sec) 01:30:42.161137 run osmo-hlr_10.42.42.2(pid=8933): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8933)] 01:30:42.210778 run osmo-hlr_10.42.42.2(pid=8933): stdout: | (launched: 2022-12-10_01:30:38.778889) 01:30:42.262256 run osmo-hlr_10.42.42.2(pid=8933): stderr: | 20221210013038980 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013038981 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013038981 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013038981 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013038981 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013038981 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013038992 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013039001 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013039001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013039001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:30:42.313893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8928): Terminating (SIGTERM) 01:30:42.355353 run iperf3-srv_10.42.42.10(pid=8929): Terminating (SIGTERM) 01:30:42.396500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8932): Terminating (SIGTERM) 01:30:42.437719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8935): Terminating (SIGTERM) 01:30:42.479335 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8938): Terminating (SIGTERM) 01:30:42.521243 --- ParallelTerminationStrategy: PID 8928 died... 01:30:42.541231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8928): Terminated: ok {rc=0} 01:30:42.587764 --- ParallelTerminationStrategy: PID 8929 died... 01:30:42.607495 run iperf3-srv_10.42.42.10(pid=8929): Terminated {rc=256} 01:30:42.653330 --- ParallelTerminationStrategy: PID 8932 died... 01:30:42.672878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8932): Terminated: ok {rc=0} 01:30:42.718681 --- ParallelTerminationStrategy: PID 8935 died... 01:30:42.738277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8935): Terminated: ok {rc=0} 01:30:42.784181 --- ParallelTerminationStrategy: PID 8938 died... 01:30:42.803970 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8938): Terminated: ok {rc=0} 01:30:42.892157 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 01:30:44.044553 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:44.056823 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:30:44.128005 tst iperf3m4.py: using LAC 25049 01:30:44.248647 tst iperf3m4.py: using RAC 59 01:30:44.368139 tst iperf3m4.py: using CellId 25049 01:30:44.488381 tst iperf3m4.py: using BVCI 25050 01:30:44.598914 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:44.610041 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:44.620761 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:44.631717 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:44.642597 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:44.653598 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:44.664754 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:44.675553 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:44.686531 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:30:44.802933 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:30:44.924736 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:30:45.040266 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:30:45.160321 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:30:45.378485 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:30:45.701262 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8940): Launched 01:30:46.017721 run iperf3-srv_10.42.42.10(pid=8941): Launched 01:30:46.144636 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:30:46.354134 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:30:46.669830 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8942): Launched 01:30:46.968283 run iperf3-srv_10.42.42.10(pid=8943): Launched 01:30:47.113872 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:30:47.319454 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:30:47.622598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8944): Launched 01:30:47.885883 run iperf3-srv_10.42.42.10(pid=8945): Launched 01:30:48.000112 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:30:48.202839 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:30:48.505570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8947): Launched 01:30:48.770146 run iperf3-srv_10.42.42.10(pid=8948): Launched 01:30:48.884060 tst iperf3m4.py:8: start network... 01:30:49.085935 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:30:49.554355 run create_hlr_db(pid=8949): Launched 01:30:49.671361 bus /gobi_6: Setting Powered False 01:30:50.731517 run create_hlr_db(pid=8949): Terminated: ok {rc=0} 01:30:51.174834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8951): Launched 01:30:51.500599 run osmo-hlr_10.42.42.2(pid=8952): Launched 01:30:51.625685 run osmo-stp_10.42.42.5: Starting osmo-stp 01:30:52.187994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8954): Launched 01:30:52.513663 run osmo-stp_10.42.42.5(pid=8955): Launched 01:30:52.638068 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:30:53.197905 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8957): Launched 01:30:53.323445 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:30:53.597355 run patchelf(pid=8958): Launched 01:30:53.776483 run osmo-stp_10.42.42.5(pid=8955): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8955)] 01:30:53.912399 run osmo-stp_10.42.42.5(pid=8955): stdout: | (launched: 2022-12-10_01:30:52.454180) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:30:54.050305 run osmo-stp_10.42.42.5(pid=8955): stderr: | 20221210013052645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013052645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013052646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013052646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013052647 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013052647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013052647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:30:54.188556 run osmo-stp_10.42.42.5(pid=8955): stdout: | (launched: 2022-12-10_01:30:52.454180) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:30:54.320519 run osmo-stp_10.42.42.5(pid=8955): stderr: | 20221210013052645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013052645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013052646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013052646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013052647 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013052647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013052647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:30:54.477245 run patchelf(pid=8958): Terminating (SIGINT) 01:30:54.657184 run patchelf(pid=8958): Terminated: ok {rc=0} 01:30:54.786436 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8955): Process ended prematurely: osmo-stp_10.42.42.5(pid=8955) [trial-2367↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8955)] [trial-2367↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 01:30:54.796726 tst iperf3m4.py:8: Test FAILED (10.8 sec) 01:30:54.825530 run osmo-hlr_10.42.42.2(pid=8952): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8952)] 01:30:54.875158 run osmo-hlr_10.42.42.2(pid=8952): stdout: | (launched: 2022-12-10_01:30:51.441298) 01:30:54.926696 run osmo-hlr_10.42.42.2(pid=8952): stderr: | 20221210013051639 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013051639 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013051639 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013051639 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013051639 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013051639 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013051651 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013051660 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013051660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013051660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:30:54.979055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8940): Terminating (SIGTERM) 01:30:55.021084 run iperf3-srv_10.42.42.10(pid=8941): Terminating (SIGTERM) 01:30:55.062733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8942): Terminating (SIGTERM) 01:30:55.104588 run iperf3-srv_10.42.42.10(pid=8943): Terminating (SIGTERM) 01:30:55.146292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8944): Terminating (SIGTERM) 01:30:55.188348 run iperf3-srv_10.42.42.10(pid=8945): Terminating (SIGTERM) 01:30:55.229986 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8947): Terminating (SIGTERM) 01:30:55.271670 run iperf3-srv_10.42.42.10(pid=8948): Terminating (SIGTERM) 01:30:55.313352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8951): Terminating (SIGTERM) 01:30:55.355073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8954): Terminating (SIGTERM) 01:30:55.396520 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8957): Terminating (SIGTERM) 01:30:55.438596 --- ParallelTerminationStrategy: PID 8940 died... 01:30:55.458601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8940): Terminated: ok {rc=0} 01:30:55.504852 --- ParallelTerminationStrategy: PID 8941 died... 01:30:55.524633 run iperf3-srv_10.42.42.10(pid=8941): Terminated {rc=256} 01:30:55.570344 --- ParallelTerminationStrategy: PID 8942 died... 01:30:55.590062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8942): Terminated: ok {rc=0} 01:30:55.635720 --- ParallelTerminationStrategy: PID 8943 died... 01:30:55.655181 run iperf3-srv_10.42.42.10(pid=8943): Terminated {rc=256} 01:30:55.701138 --- ParallelTerminationStrategy: PID 8944 died... 01:30:55.720617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8944): Terminated: ok {rc=0} 01:30:55.766439 --- ParallelTerminationStrategy: PID 8945 died... 01:30:55.786007 run iperf3-srv_10.42.42.10(pid=8945): Terminated {rc=256} 01:30:55.831695 --- ParallelTerminationStrategy: PID 8947 died... 01:30:55.851392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8947): Terminated: ok {rc=0} 01:30:55.897385 --- ParallelTerminationStrategy: PID 8948 died... 01:30:55.917174 run iperf3-srv_10.42.42.10(pid=8948): Terminated {rc=256} 01:30:55.963275 --- ParallelTerminationStrategy: PID 8951 died... 01:30:55.983060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8951): Terminated: ok {rc=0} 01:30:56.029137 --- ParallelTerminationStrategy: PID 8954 died... 01:30:56.048727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8954): Terminated: ok {rc=0} 01:30:56.095207 --- ParallelTerminationStrategy: PID 8957 died... 01:30:56.115168 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8957): Terminated: ok {rc=0} 01:30:56.203028 bus /gobi_4: Setting Powered False 01:30:57.302349 bus /gobi_4: Setting Powered False 01:30:58.421414 bus /gobi_1: Setting Powered False 01:30:59.520289 bus /gobi_1: Setting Powered False 01:31:00.638154 bus /gobi_0: Setting Powered False 01:31:01.737423 bus /gobi_0: Setting Powered False 01:31:02.856006 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 01:31:03.959444 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:03.971956 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:31:04.044456 tst ping.py: using LAC 25050 01:31:04.173433 tst ping.py: using RAC 60 01:31:04.297817 tst ping.py: using CellId 25050 01:31:04.420048 tst ping.py: using BVCI 25051 01:31:04.534714 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:04.546043 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:04.557127 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:04.568271 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:04.579439 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:04.590588 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:04.601803 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:04.612888 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:31:04.728132 tst ping.py:19: start network... 01:31:04.942931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:31:05.435697 run create_hlr_db(pid=8959): Launched 01:31:05.566546 bus /gobi_6: Setting Powered False 01:31:06.629901 run create_hlr_db(pid=8959): Terminated: ok {rc=0} 01:31:07.071595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8961): Launched 01:31:07.389930 run osmo-hlr_10.42.42.2(pid=8962): Launched 01:31:07.514535 run osmo-stp_10.42.42.5: Starting osmo-stp 01:31:08.065490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8964): Launched 01:31:08.384320 run osmo-stp_10.42.42.5(pid=8965): Launched 01:31:08.505934 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:31:09.053205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8967): Launched 01:31:09.174679 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:31:09.442350 run patchelf(pid=8968): Launched 01:31:09.620183 run osmo-stp_10.42.42.5(pid=8965): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8965)] 01:31:09.754289 run osmo-stp_10.42.42.5(pid=8965): stdout: | (launched: 2022-12-10_01:31:08.326011) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:31:09.889836 run osmo-stp_10.42.42.5(pid=8965): stderr: | 20221210013108519 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013108519 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013108519 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013108520 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013108520 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013108520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013108520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:31:10.025787 run osmo-stp_10.42.42.5(pid=8965): stdout: | (launched: 2022-12-10_01:31:08.326011) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:31:10.156318 run osmo-stp_10.42.42.5(pid=8965): stderr: | 20221210013108519 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013108519 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013108519 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013108520 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013108520 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013108520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013108520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:31:10.311254 run patchelf(pid=8968): Terminating (SIGINT) 01:31:10.487929 run patchelf(pid=8968): Terminated: ok {rc=0} 01:31:10.615671 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8965): Process ended prematurely: osmo-stp_10.42.42.5(pid=8965) [trial-2367↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8965)] [trial-2367↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 01:31:10.625318 tst ping.py:22: Test FAILED (6.7 sec) 01:31:10.653766 run osmo-hlr_10.42.42.2(pid=8962): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8962)] 01:31:10.704019 run osmo-hlr_10.42.42.2(pid=8962): stdout: | (launched: 2022-12-10_01:31:07.331581) 01:31:10.755954 run osmo-hlr_10.42.42.2(pid=8962): stderr: | 20221210013107532 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013107532 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013107532 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013107532 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013107532 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013107532 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013107545 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013107553 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013107554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013107554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:31:10.808419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8961): Terminating (SIGTERM) 01:31:10.850278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8964): Terminating (SIGTERM) 01:31:10.892172 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8967): Terminating (SIGTERM) 01:31:10.934520 --- ParallelTerminationStrategy: PID 8961 died... 01:31:10.954674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8961): Terminated: ok {rc=0} 01:31:11.001721 --- ParallelTerminationStrategy: PID 8964 died... 01:31:11.021481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8964): Terminated: ok {rc=0} 01:31:11.067863 --- ParallelTerminationStrategy: PID 8967 died... 01:31:11.087658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8967): Terminated: ok {rc=0} 01:31:11.175200 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 01:31:12.263073 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:12.275218 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:31:12.347375 tst ping_idle_ping.py: using LAC 25051 01:31:12.465428 tst ping_idle_ping.py: using RAC 61 01:31:12.591854 tst ping_idle_ping.py: using CellId 25051 01:31:12.711642 tst ping_idle_ping.py: using BVCI 25052 01:31:12.829237 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:12.840588 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:12.851825 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:12.863034 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:12.874389 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:12.885607 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:12.896814 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:12.907985 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:31:13.024466 tst ping_idle_ping.py:24: start network... 01:31:13.224638 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:31:13.690435 run create_hlr_db(pid=8969): Launched 01:31:13.806099 bus /gobi_6: Setting Powered False 01:31:14.866210 run create_hlr_db(pid=8969): Terminated: ok {rc=0} 01:31:15.282753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8971): Launched 01:31:15.581841 run osmo-hlr_10.42.42.2(pid=8972): Launched 01:31:15.698182 run osmo-stp_10.42.42.5: Starting osmo-stp 01:31:16.237458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8974): Launched 01:31:16.575943 run osmo-stp_10.42.42.5(pid=8975): Launched 01:31:16.818976 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:31:17.461989 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8977): Launched 01:31:17.585850 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:31:17.855784 run patchelf(pid=8978): Launched 01:31:18.034612 run osmo-stp_10.42.42.5(pid=8975): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8975)] 01:31:18.170080 run osmo-stp_10.42.42.5(pid=8975): stdout: | (launched: 2022-12-10_01:31:16.516238) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:31:18.307184 run osmo-stp_10.42.42.5(pid=8975): stderr: | 20221210013116812 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013116812 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013116821 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013116822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013116822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013116822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013116822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:31:18.443830 run osmo-stp_10.42.42.5(pid=8975): stdout: | (launched: 2022-12-10_01:31:16.516238) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:31:18.575426 run osmo-stp_10.42.42.5(pid=8975): stderr: | 20221210013116812 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013116812 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013116821 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013116822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013116822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013116822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013116822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:31:18.731071 run patchelf(pid=8978): Terminating (SIGINT) 01:31:18.909130 run patchelf(pid=8978): Terminated: ok {rc=0} 01:31:19.037700 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8975): Process ended prematurely: osmo-stp_10.42.42.5(pid=8975) [trial-2367↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8975)] [trial-2367↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 01:31:19.047138 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 01:31:19.075514 run osmo-hlr_10.42.42.2(pid=8972): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8972)] 01:31:19.125791 run osmo-hlr_10.42.42.2(pid=8972): stdout: | (launched: 2022-12-10_01:31:15.526391) 01:31:19.177583 run osmo-hlr_10.42.42.2(pid=8972): stderr: | 20221210013115707 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013115707 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013115707 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013115708 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013115708 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013115708 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013115719 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013115727 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013115727 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013115727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:31:19.229764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8971): Terminating (SIGTERM) 01:31:19.271899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8974): Terminating (SIGTERM) 01:31:19.314166 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8977): Terminating (SIGTERM) 01:31:19.356539 --- ParallelTerminationStrategy: PID 8971 died... 01:31:19.376735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8971): Terminated: ok {rc=0} 01:31:19.423358 --- ParallelTerminationStrategy: PID 8974 died... 01:31:19.442981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8974): Terminated: ok {rc=0} 01:31:19.489609 --- ParallelTerminationStrategy: PID 8977 died... 01:31:19.509379 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8977): Terminated: ok {rc=0} 01:31:19.598159 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 01:31:20.899138 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:31:20.905250 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 01:31:20.939028 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 01:31:20.977150 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 01:31:21.066009 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 01:31:21.099121 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 01:31:21.137069 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 01:31:21.726821 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 01:31:21.776622 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:21.787486 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:31:21.856414 tst cs_paging_gprs_active.py: using LAC 25052 01:31:21.975247 tst cs_paging_gprs_active.py: using RAC 62 01:31:22.095153 tst cs_paging_gprs_active.py: using CellId 25052 01:31:22.215790 tst cs_paging_gprs_active.py: using BVCI 25053 01:31:22.327668 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:22.338578 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:22.349363 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:22.360100 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:22.370940 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:22.381828 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:22.392711 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:22.403533 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:22.414528 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:31:22.535218 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:31:22.656211 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:31:22.860783 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:31:23.164374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8984): Launched 01:31:23.427956 run iperf3-srv_10.42.42.10(pid=8985): Launched 01:31:23.541877 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:31:23.743718 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:31:24.047290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8986): Launched 01:31:24.311334 run iperf3-srv_10.42.42.10(pid=8987): Launched 01:31:24.425133 tst cs_paging_gprs_active.py:38: start network... 01:31:24.626838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:31:25.095813 run create_hlr_db(pid=8988): Launched 01:31:25.228505 bus /gobi_6: Setting Powered False 01:31:26.292730 run create_hlr_db(pid=8988): Terminated: ok {rc=0} 01:31:26.723183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8990): Launched 01:31:27.026005 run osmo-hlr_10.42.42.2(pid=8991): Launched 01:31:27.142367 run osmo-stp_10.42.42.5: Starting osmo-stp 01:31:27.683264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8993): Launched 01:31:27.987295 run osmo-stp_10.42.42.5(pid=8994): Launched 01:31:28.104212 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:31:28.628285 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8996): Launched 01:31:28.745042 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:31:29.001176 run patchelf(pid=8997): Launched 01:31:29.171802 run osmo-stp_10.42.42.5(pid=8994): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8994)] 01:31:29.299677 run osmo-stp_10.42.42.5(pid=8994): stdout: | (launched: 2022-12-10_01:31:27.931453) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:31:29.428864 run osmo-stp_10.42.42.5(pid=8994): stderr: | 20221210013128101 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013128101 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013128101 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013128102 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013128102 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013128102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013128102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:31:29.558583 run osmo-stp_10.42.42.5(pid=8994): stdout: | (launched: 2022-12-10_01:31:27.931453) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:31:29.682042 run osmo-stp_10.42.42.5(pid=8994): stderr: | 20221210013128101 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013128101 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013128101 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013128102 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013128102 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013128102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013128102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:31:29.829127 run patchelf(pid=8997): Terminating (SIGINT) 01:31:29.998360 run patchelf(pid=8997): Terminated: ok {rc=0} 01:31:30.120293 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8994): Process ended prematurely: osmo-stp_10.42.42.5(pid=8994) [trial-2367↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8994)] [trial-2367↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 01:31:30.129762 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 01:31:30.156837 run osmo-hlr_10.42.42.2(pid=8991): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8991)] 01:31:30.204484 run osmo-hlr_10.42.42.2(pid=8991): stdout: | (launched: 2022-12-10_01:31:26.970049) 01:31:30.253649 run osmo-hlr_10.42.42.2(pid=8991): stderr: | 20221210013127145 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013127145 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013127146 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013127146 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013127146 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013127146 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013127158 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013127166 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013127167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013127167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:31:30.303086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8984): Terminating (SIGTERM) 01:31:30.342720 run iperf3-srv_10.42.42.10(pid=8985): Terminating (SIGTERM) 01:31:30.382239 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8986): Terminating (SIGTERM) 01:31:30.421596 run iperf3-srv_10.42.42.10(pid=8987): Terminating (SIGTERM) 01:31:30.460571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8990): Terminating (SIGTERM) 01:31:30.499566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8993): Terminating (SIGTERM) 01:31:30.539287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8996): Terminating (SIGTERM) 01:31:30.578699 --- ParallelTerminationStrategy: PID 8984 died... 01:31:30.597498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8984): Terminated: ok {rc=0} 01:31:30.641316 --- ParallelTerminationStrategy: PID 8985 died... 01:31:30.659591 run iperf3-srv_10.42.42.10(pid=8985): Terminated {rc=256} 01:31:30.704079 --- ParallelTerminationStrategy: PID 8986 died... 01:31:30.722444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8986): Terminated: ok {rc=0} 01:31:30.765951 --- ParallelTerminationStrategy: PID 8987 died... 01:31:30.784192 run iperf3-srv_10.42.42.10(pid=8987): Terminated {rc=256} 01:31:30.828591 --- ParallelTerminationStrategy: PID 8990 died... 01:31:30.860252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8990): Terminated: ok {rc=0} 01:31:30.923776 --- ParallelTerminationStrategy: PID 8993 died... 01:31:30.945517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8993): Terminated: ok {rc=0} 01:31:30.993411 --- ParallelTerminationStrategy: PID 8996 died... 01:31:31.013362 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8996): Terminated: ok {rc=0} 01:31:31.105076 bus /gobi_0: Setting Powered False 01:31:32.206542 bus /gobi_0: Setting Powered False 01:31:33.322144 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 01:31:34.467506 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:34.479086 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:31:34.553406 tst iperf3.py: using LAC 25053 01:31:34.680523 tst iperf3.py: using RAC 63 01:31:34.808636 tst iperf3.py: using CellId 25053 01:31:34.935029 tst iperf3.py: using BVCI 25054 01:31:35.054988 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:35.066460 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:35.077565 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:35.088597 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:35.099677 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:35.111277 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:35.122976 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:35.134136 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:35.145493 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:31:35.265282 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:31:35.482931 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:31:35.806939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8999): Launched 01:31:36.091349 run iperf3-srv_10.42.42.10(pid=9000): Launched 01:31:36.215001 tst iperf3.py:8: start network... 01:31:36.432580 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:31:36.934523 run create_hlr_db(pid=9001): Launched 01:31:37.069087 bus /gobi_6: Setting Powered False 01:31:38.133837 run create_hlr_db(pid=9001): Terminated: ok {rc=0} 01:31:38.567651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9003): Launched 01:31:38.894462 run osmo-hlr_10.42.42.2(pid=9004): Launched 01:31:39.020171 run osmo-stp_10.42.42.5: Starting osmo-stp 01:31:39.580624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9006): Launched 01:31:39.905914 run osmo-stp_10.42.42.5(pid=9007): Launched 01:31:40.032908 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:31:40.592925 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9009): Launched 01:31:40.716942 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:31:40.990463 run patchelf(pid=9010): Launched 01:31:41.172070 run osmo-stp_10.42.42.5(pid=9007): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9007)] 01:31:41.309171 run osmo-stp_10.42.42.5(pid=9007): stdout: | (launched: 2022-12-10_01:31:39.846468) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:31:41.447282 run osmo-stp_10.42.42.5(pid=9007): stderr: | 20221210013140043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013140043 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013140043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013140044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013140044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013140044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013140044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:31:41.585437 run osmo-stp_10.42.42.5(pid=9007): stdout: | (launched: 2022-12-10_01:31:39.846468) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:31:41.718063 run osmo-stp_10.42.42.5(pid=9007): stderr: | 20221210013140043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013140043 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013140043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013140044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013140044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013140044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013140044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:31:41.875213 run patchelf(pid=9010): Terminating (SIGINT) 01:31:42.056100 run patchelf(pid=9010): Terminated: ok {rc=0} 01:31:42.186162 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9007): Process ended prematurely: osmo-stp_10.42.42.5(pid=9007) [trial-2367↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9007)] [trial-2367↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 01:31:42.196188 tst iperf3.py:8: Test FAILED (7.8 sec) 01:31:42.224883 run osmo-hlr_10.42.42.2(pid=9004): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9004)] 01:31:42.274926 run osmo-hlr_10.42.42.2(pid=9004): stdout: | (launched: 2022-12-10_01:31:38.835215) 01:31:42.326689 run osmo-hlr_10.42.42.2(pid=9004): stderr: | 20221210013139035 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013139035 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013139035 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013139035 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013139035 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013139035 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013139048 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013139057 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013139057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013139057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:31:42.379417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8999): Terminating (SIGTERM) 01:31:42.421377 run iperf3-srv_10.42.42.10(pid=9000): Terminating (SIGTERM) 01:31:42.463637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9003): Terminating (SIGTERM) 01:31:42.505520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9006): Terminating (SIGTERM) 01:31:42.547504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9009): Terminating (SIGTERM) 01:31:42.589814 --- ParallelTerminationStrategy: PID 8999 died... 01:31:42.609970 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8999): Terminated: ok {rc=0} 01:31:42.656640 --- ParallelTerminationStrategy: PID 9000 died... 01:31:42.676363 run iperf3-srv_10.42.42.10(pid=9000): Terminated {rc=256} 01:31:42.722410 --- ParallelTerminationStrategy: PID 9003 died... 01:31:42.742232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9003): Terminated: ok {rc=0} 01:31:42.788574 --- ParallelTerminationStrategy: PID 9006 died... 01:31:42.808404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9006): Terminated: ok {rc=0} 01:31:42.854750 --- ParallelTerminationStrategy: PID 9009 died... 01:31:42.874510 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9009): Terminated: ok {rc=0} 01:31:42.962718 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 01:31:44.114556 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:44.126917 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:31:44.199663 tst iperf3m4.py: using LAC 25054 01:31:44.327784 tst iperf3m4.py: using RAC 64 01:31:44.454603 tst iperf3m4.py: using CellId 25054 01:31:44.577040 tst iperf3m4.py: using BVCI 25055 01:31:44.687544 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:44.698627 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:44.709583 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:44.720862 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:44.732380 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:44.743923 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:44.755842 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:44.767122 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:44.778684 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:31:44.897965 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:31:45.017622 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:31:45.137456 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:31:45.258299 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:31:45.477801 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:31:45.803152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9011): Launched 01:31:46.127064 run iperf3-srv_10.42.42.10(pid=9012): Launched 01:31:46.258261 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:31:46.476861 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:31:46.795280 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9013): Launched 01:31:47.078128 run iperf3-srv_10.42.42.10(pid=9014): Launched 01:31:47.210641 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:31:47.416006 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:31:47.721777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9015): Launched 01:31:47.988050 run iperf3-srv_10.42.42.10(pid=9016): Launched 01:31:48.103121 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:31:48.304933 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:31:48.608916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9017): Launched 01:31:48.873871 run iperf3-srv_10.42.42.10(pid=9018): Launched 01:31:48.988237 tst iperf3m4.py:8: start network... 01:31:49.191446 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:31:49.663031 run create_hlr_db(pid=9019): Launched 01:31:49.778793 bus /gobi_6: Setting Powered False 01:31:50.839722 run create_hlr_db(pid=9019): Terminated: ok {rc=0} 01:31:51.260933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9021): Launched 01:31:51.563645 run osmo-hlr_10.42.42.2(pid=9022): Launched 01:31:51.679568 run osmo-stp_10.42.42.5: Starting osmo-stp 01:31:52.217115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9024): Launched 01:31:52.520937 run osmo-stp_10.42.42.5(pid=9025): Launched 01:31:52.640113 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:31:53.161735 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9027): Launched 01:31:53.278057 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:31:53.534301 run patchelf(pid=9028): Launched 01:31:53.703466 run osmo-stp_10.42.42.5(pid=9025): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9025)] 01:31:53.831718 run osmo-stp_10.42.42.5(pid=9025): stdout: | (launched: 2022-12-10_01:31:52.464890) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:31:53.961914 run osmo-stp_10.42.42.5(pid=9025): stderr: | 20221210013152636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013152636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013152636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013152637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013152637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013152637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013152637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:31:54.092001 run osmo-stp_10.42.42.5(pid=9025): stdout: | (launched: 2022-12-10_01:31:52.464890) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:31:54.217088 run osmo-stp_10.42.42.5(pid=9025): stderr: | 20221210013152636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013152636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013152636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013152637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013152637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013152637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013152637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:31:54.364640 run patchelf(pid=9028): Terminating (SIGINT) 01:31:54.534534 run patchelf(pid=9028): Terminated: ok {rc=0} 01:31:54.656841 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9025): Process ended prematurely: osmo-stp_10.42.42.5(pid=9025) [trial-2367↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9025)] [trial-2367↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 01:31:54.666375 tst iperf3m4.py:8: Test FAILED (10.6 sec) 01:31:54.694547 run osmo-hlr_10.42.42.2(pid=9022): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9022)] 01:31:54.742041 run osmo-hlr_10.42.42.2(pid=9022): stdout: | (launched: 2022-12-10_01:31:51.507798) 01:31:54.791452 run osmo-hlr_10.42.42.2(pid=9022): stderr: | 20221210013151686 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013151686 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013151686 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013151686 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013151686 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013151686 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013151698 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013151707 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013151707 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013151707 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:31:54.841430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9011): Terminating (SIGTERM) 01:31:54.881625 run iperf3-srv_10.42.42.10(pid=9012): Terminating (SIGTERM) 01:31:54.922115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9013): Terminating (SIGTERM) 01:31:54.962181 run iperf3-srv_10.42.42.10(pid=9014): Terminating (SIGTERM) 01:31:55.002013 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9015): Terminating (SIGTERM) 01:31:55.041919 run iperf3-srv_10.42.42.10(pid=9016): Terminating (SIGTERM) 01:31:55.081793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9017): Terminating (SIGTERM) 01:31:55.121775 run iperf3-srv_10.42.42.10(pid=9018): Terminating (SIGTERM) 01:31:55.161743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9021): Terminating (SIGTERM) 01:31:55.201677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9024): Terminating (SIGTERM) 01:31:55.241612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9027): Terminating (SIGTERM) 01:31:55.281917 --- ParallelTerminationStrategy: PID 9011 died... 01:31:55.301244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9011): Terminated: ok {rc=0} 01:31:55.345856 --- ParallelTerminationStrategy: PID 9012 died... 01:31:55.364352 run iperf3-srv_10.42.42.10(pid=9012): Terminated {rc=256} 01:31:55.408731 --- ParallelTerminationStrategy: PID 9013 died... 01:31:55.427542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9013): Terminated: ok {rc=0} 01:31:55.471702 --- ParallelTerminationStrategy: PID 9014 died... 01:31:55.490218 run iperf3-srv_10.42.42.10(pid=9014): Terminated {rc=256} 01:31:55.534104 --- ParallelTerminationStrategy: PID 9015 died... 01:31:55.552595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9015): Terminated: ok {rc=0} 01:31:55.597509 --- ParallelTerminationStrategy: PID 9016 died... 01:31:55.616094 run iperf3-srv_10.42.42.10(pid=9016): Terminated {rc=256} 01:31:55.660844 --- ParallelTerminationStrategy: PID 9017 died... 01:31:55.679694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9017): Terminated: ok {rc=0} 01:31:55.724064 --- ParallelTerminationStrategy: PID 9018 died... 01:31:55.742606 run iperf3-srv_10.42.42.10(pid=9018): Terminated {rc=256} 01:31:55.786550 --- ParallelTerminationStrategy: PID 9021 died... 01:31:55.805214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9021): Terminated: ok {rc=0} 01:31:55.849433 --- ParallelTerminationStrategy: PID 9024 died... 01:31:55.868044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9024): Terminated: ok {rc=0} 01:31:55.912666 --- ParallelTerminationStrategy: PID 9027 died... 01:31:55.931561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9027): Terminated: ok {rc=0} 01:31:56.015951 bus /gobi_4: Setting Powered False 01:31:57.115360 bus /gobi_4: Setting Powered False 01:31:58.233598 bus /gobi_1: Setting Powered False 01:31:59.331854 bus /gobi_1: Setting Powered False 01:32:00.447664 bus /gobi_0: Setting Powered False 01:32:01.546212 bus /gobi_0: Setting Powered False 01:32:02.665641 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 01:32:03.768658 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:03.780355 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:32:03.850217 tst ping.py: using LAC 25055 01:32:03.967631 tst ping.py: using RAC 65 01:32:04.084056 tst ping.py: using CellId 25055 01:32:04.199879 tst ping.py: using BVCI 25056 01:32:04.307001 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:04.317983 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:04.328508 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:04.339471 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:04.350394 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:04.361512 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:04.372384 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:04.383194 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:32:04.496376 tst ping.py:19: start network... 01:32:04.695791 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:32:05.157326 run create_hlr_db(pid=9029): Launched 01:32:05.276476 bus /gobi_6: Setting Powered False 01:32:06.340405 run create_hlr_db(pid=9029): Terminated: ok {rc=0} 01:32:06.785338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9031): Launched 01:32:07.107311 run osmo-hlr_10.42.42.2(pid=9032): Launched 01:32:07.230653 run osmo-stp_10.42.42.5: Starting osmo-stp 01:32:07.790664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9034): Launched 01:32:08.110930 run osmo-stp_10.42.42.5(pid=9035): Launched 01:32:08.233737 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:32:08.783335 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9037): Launched 01:32:08.906936 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:32:09.176102 run patchelf(pid=9038): Launched 01:32:09.355174 run osmo-stp_10.42.42.5(pid=9035): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9035)] 01:32:09.489858 run osmo-stp_10.42.42.5(pid=9035): stdout: | (launched: 2022-12-10_01:32:08.052345) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:32:09.625845 run osmo-stp_10.42.42.5(pid=9035): stderr: | 20221210013208245 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013208245 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013208245 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013208245 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013208246 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013208246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013208246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:32:09.761949 run osmo-stp_10.42.42.5(pid=9035): stdout: | (launched: 2022-12-10_01:32:08.052345) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:32:09.892852 run osmo-stp_10.42.42.5(pid=9035): stderr: | 20221210013208245 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013208245 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013208245 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013208245 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013208246 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013208246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013208246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:32:10.048406 run patchelf(pid=9038): Terminating (SIGINT) 01:32:10.226039 run patchelf(pid=9038): Terminated: ok {rc=0} 01:32:10.354328 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9035): Process ended prematurely: osmo-stp_10.42.42.5(pid=9035) [trial-2367↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9035)] [trial-2367↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 01:32:10.363965 tst ping.py:22: Test FAILED (6.6 sec) 01:32:10.392469 run osmo-hlr_10.42.42.2(pid=9032): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9032)] 01:32:10.442292 run osmo-hlr_10.42.42.2(pid=9032): stdout: | (launched: 2022-12-10_01:32:07.048651) 01:32:10.493928 run osmo-hlr_10.42.42.2(pid=9032): stderr: | 20221210013207244 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013207245 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013207245 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013207245 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013207245 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013207245 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013207256 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013207264 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013207264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013207264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:32:10.545973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9031): Terminating (SIGTERM) 01:32:10.587667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9034): Terminating (SIGTERM) 01:32:10.629069 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9037): Terminating (SIGTERM) 01:32:10.671029 --- ParallelTerminationStrategy: PID 9031 died... 01:32:10.691437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9031): Terminated: ok {rc=0} 01:32:10.737835 --- ParallelTerminationStrategy: PID 9034 died... 01:32:10.757528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9034): Terminated: ok {rc=0} 01:32:10.803810 --- ParallelTerminationStrategy: PID 9037 died... 01:32:10.823652 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9037): Terminated: ok {rc=0} 01:32:10.911187 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 01:32:11.999060 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:12.011128 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:32:12.086625 tst ping_idle_ping.py: using LAC 25056 01:32:12.211695 tst ping_idle_ping.py: using RAC 66 01:32:12.328371 tst ping_idle_ping.py: using CellId 25056 01:32:12.449425 tst ping_idle_ping.py: using BVCI 25057 01:32:12.560207 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:12.571319 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:12.582211 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:12.593865 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:12.605314 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:12.616641 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:12.628066 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:12.639356 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:32:12.753541 tst ping_idle_ping.py:24: start network... 01:32:12.952362 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:32:13.418204 run create_hlr_db(pid=9039): Launched 01:32:13.534570 bus /gobi_6: Setting Powered False 01:32:14.594565 run create_hlr_db(pid=9039): Terminated: ok {rc=0} 01:32:15.031356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9041): Launched 01:32:15.353443 run osmo-hlr_10.42.42.2(pid=9042): Launched 01:32:15.476751 run osmo-stp_10.42.42.5: Starting osmo-stp 01:32:16.061841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9044): Launched 01:32:16.380116 run osmo-stp_10.42.42.5(pid=9045): Launched 01:32:16.691313 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:32:17.333355 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9047): Launched 01:32:17.461123 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:32:17.713945 run patchelf(pid=9048): Launched 01:32:17.879641 run osmo-stp_10.42.42.5(pid=9045): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9045)] 01:32:18.005242 run osmo-stp_10.42.42.5(pid=9045): stdout: | (launched: 2022-12-10_01:32:16.321783) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:32:18.132228 run osmo-stp_10.42.42.5(pid=9045): stderr: | 20221210013216528 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013216528 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013216528 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013216529 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013216529 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013216529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013216529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:32:18.259220 run osmo-stp_10.42.42.5(pid=9045): stdout: | (launched: 2022-12-10_01:32:16.321783) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:32:18.381119 run osmo-stp_10.42.42.5(pid=9045): stderr: | 20221210013216528 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013216528 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013216528 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013216529 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013216529 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013216529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013216529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:32:18.525550 run patchelf(pid=9048): Terminating (SIGINT) 01:32:18.691758 run patchelf(pid=9048): Terminated: ok {rc=0} 01:32:18.811877 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9045): Process ended prematurely: osmo-stp_10.42.42.5(pid=9045) [trial-2367↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9045)] [trial-2367↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 01:32:18.820649 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 01:32:18.848340 run osmo-hlr_10.42.42.2(pid=9042): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9042)] 01:32:18.896102 run osmo-hlr_10.42.42.2(pid=9042): stdout: | (launched: 2022-12-10_01:32:15.294696) 01:32:18.945573 run osmo-hlr_10.42.42.2(pid=9042): stderr: | 20221210013215491 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013215491 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013215492 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013215492 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013215492 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013215492 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013215504 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013215513 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013215513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013215513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:32:18.995472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9041): Terminating (SIGTERM) 01:32:19.035431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9044): Terminating (SIGTERM) 01:32:19.075435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9047): Terminating (SIGTERM) 01:32:19.115754 --- ParallelTerminationStrategy: PID 9041 died... 01:32:19.134848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9041): Terminated: ok {rc=0} 01:32:19.179324 --- ParallelTerminationStrategy: PID 9044 died... 01:32:19.198010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9044): Terminated: ok {rc=0} 01:32:19.242388 --- ParallelTerminationStrategy: PID 9047 died... 01:32:19.260682 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9047): Terminated: ok {rc=0} 01:32:19.347067 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:32:20.648800 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:32:20.655739 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:32:20.689374 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 01:32:20.723691 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:32:20.776535 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:32:20.809406 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 01:32:20.843565 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:32:21.399676 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2367 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 01:32:21.404728 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:32:21.415919 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:32:21.485560 tst switch_tch_pdch.py: using LAC 25057 01:32:21.612604 tst switch_tch_pdch.py: using RAC 67 01:32:21.737981 tst switch_tch_pdch.py: using CellId 25057 01:32:21.864423 tst switch_tch_pdch.py: using BVCI 25058 01:32:21.980452 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:32:21.992319 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:32:22.004304 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:32:22.016140 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:32:22.028375 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:32:22.040118 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:32:22.052125 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:32:22.063847 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:32:22.178896 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:32:22.298582 tst switch_tch_pdch.py:51: start network... 01:32:22.497240 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:32:22.957704 run create_hlr_db(pid=9053): Launched 01:32:23.073450 bus /gobi_6: Setting Powered False 01:32:24.132589 run create_hlr_db(pid=9053): Terminated: ok {rc=0} 01:32:24.567223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9055): Launched 01:32:24.887298 run osmo-hlr_10.42.42.2(pid=9056): Launched 01:32:25.009536 run osmo-stp_10.42.42.5: Starting osmo-stp 01:32:25.555508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9058): Launched 01:32:25.875429 run osmo-stp_10.42.42.5(pid=9059): Launched 01:32:25.997130 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:32:26.545605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9061): Launched 01:32:26.669673 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:32:26.939638 run patchelf(pid=9062): Launched 01:32:27.118086 run osmo-stp_10.42.42.5(pid=9059): ERR: Terminated: ERROR {rc=1} [trial-2367↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9059)] 01:32:27.252615 run osmo-stp_10.42.42.5(pid=9059): stdout: | (launched: 2022-12-10_01:32:25.816566) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:32:27.390322 run osmo-stp_10.42.42.5(pid=9059): stderr: | 20221210013226010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013226010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013226011 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013226011 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013226012 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013226012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013226012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:32:27.526507 run osmo-stp_10.42.42.5(pid=9059): stdout: | (launched: 2022-12-10_01:32:25.816566) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:32:27.656790 run osmo-stp_10.42.42.5(pid=9059): stderr: | 20221210013226010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013226010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013226011 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013226011 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013226012 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013226012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013226012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:32:27.811434 run patchelf(pid=9062): Terminating (SIGINT) 01:32:27.989026 run patchelf(pid=9062): Terminated: ok {rc=0} 01:32:28.117402 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=9059): Process ended prematurely: osmo-stp_10.42.42.5(pid=9059) [trial-2367↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9059)] [trial-2367↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 01:32:28.126803 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 01:32:28.154625 run osmo-hlr_10.42.42.2(pid=9056): ERR: Terminated: ERROR {rc=237} [trial-2367↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9056)] 01:32:28.203917 run osmo-hlr_10.42.42.2(pid=9056): stdout: | (launched: 2022-12-10_01:32:24.829269) 01:32:28.255263 run osmo-hlr_10.42.42.2(pid=9056): stderr: | 20221210013225029 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013225029 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013225029 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013225029 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013225029 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013225029 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013225046 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013225056 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013225056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013225056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:32:28.306841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9055): Terminating (SIGTERM) 01:32:28.348455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9058): Terminating (SIGTERM) 01:32:28.390490 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9061): Terminating (SIGTERM) 01:32:28.432399 --- ParallelTerminationStrategy: PID 9055 died... 01:32:28.452298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9055): Terminated: ok {rc=0} 01:32:28.498229 --- ParallelTerminationStrategy: PID 9058 died... 01:32:28.517801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9058): Terminated: ok {rc=0} 01:32:28.563501 --- ParallelTerminationStrategy: PID 9061 died... 01:32:28.583187 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9061): Terminated: ok {rc=0} 01:32:28.670311 bus /gobi_0: Setting Powered False 01:32:29.769851 bus /gobi_0: Setting Powered False 01:32:30.918686 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 01:32:32.215261 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:32:32.227061 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 01:32:32.261913 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 01:32:32.297615 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 01:32:32.353124 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 01:32:32.387407 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 01:32:32.422787 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 01:32:32.972787 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2367 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 01:32:32.978151 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:32:32.989153 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 01:32:33.059966 tst switch_tch_pdch.py: using LAC 25058 01:32:33.178157 tst switch_tch_pdch.py: using RAC 68 01:32:33.296778 tst switch_tch_pdch.py: using CellId 25058 01:32:33.413192 tst switch_tch_pdch.py: using BVCI 25059 01:32:33.522614 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:32:33.533595 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:32:33.544254 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:32:33.555735 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:32:33.567187 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:32:33.578594 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:32:33.590592 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:32:33.602054 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 01:32:33.721851 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 01:32:33.839165 tst switch_tch_pdch.py:51: start network... 01:32:34.038683 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:32:34.474199 run create_hlr_db(pid=9066): Launched 01:32:34.590925 bus /gobi_6: Setting Powered False 01:32:35.650159 run create_hlr_db(pid=9066): Terminated: ok {rc=0} 01:32:36.042080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9072): Launched 01:32:36.339598 run osmo-hlr_10.42.42.2(pid=9073): Launched 01:32:36.453242 run osmo-stp_10.42.42.5: Starting osmo-stp 01:32:36.938015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9075): Launched 01:32:37.235994 run osmo-stp_10.42.42.5(pid=9076): Launched 01:32:37.349853 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:32:37.837576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9078): Launched 01:32:37.952123 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:32:38.204725 run patchelf(pid=9079): Launched 01:32:38.370840 run osmo-stp_10.42.42.5(pid=9076): ERR: Terminated: ERROR {rc=1} [trial-2367↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9076)] 01:32:38.496186 run osmo-stp_10.42.42.5(pid=9076): stdout: | (launched: 2022-12-10_01:32:37.180765) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:32:38.623592 run osmo-stp_10.42.42.5(pid=9076): stderr: | 20221210013237353 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013237353 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013237353 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013237354 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013237354 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013237354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013237354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:32:38.750604 run osmo-stp_10.42.42.5(pid=9076): stdout: | (launched: 2022-12-10_01:32:37.180765) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:32:38.872691 run osmo-stp_10.42.42.5(pid=9076): stderr: | 20221210013237353 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013237353 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013237353 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013237354 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013237354 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013237354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013237354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:32:39.018106 run patchelf(pid=9079): Terminating (SIGINT) 01:32:39.184690 run patchelf(pid=9079): Terminated: ok {rc=0} 01:32:39.304732 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=9076): Process ended prematurely: osmo-stp_10.42.42.5(pid=9076) [trial-2367↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9076)] [trial-2367↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 01:32:39.313735 tst switch_tch_pdch.py:54: Test FAILED (6.3 sec) 01:32:39.340260 run osmo-hlr_10.42.42.2(pid=9073): ERR: Terminated: ERROR {rc=237} [trial-2367↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9073)] 01:32:39.388183 run osmo-hlr_10.42.42.2(pid=9073): stdout: | (launched: 2022-12-10_01:32:36.285113) 01:32:39.437236 run osmo-hlr_10.42.42.2(pid=9073): stderr: | 20221210013236459 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013236459 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013236459 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013236459 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013236459 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013236459 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013236471 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013236480 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013236480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013236481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:32:39.486553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9072): Terminating (SIGTERM) 01:32:39.526327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9075): Terminating (SIGTERM) 01:32:39.565557 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9078): Terminating (SIGTERM) 01:32:39.605595 --- ParallelTerminationStrategy: PID 9072 died... 01:32:39.624611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9072): Terminated: ok {rc=0} 01:32:39.668808 --- ParallelTerminationStrategy: PID 9075 died... 01:32:39.687157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9075): Terminated: ok {rc=0} 01:32:39.731213 --- ParallelTerminationStrategy: PID 9078 died... 01:32:39.749751 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9078): Terminated: ok {rc=0} 01:32:39.835477 bus /gobi_0: Setting Powered False 01:32:40.935029 bus /gobi_0: Setting Powered False 01:32:42.049140 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 01:32:43.296711 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:32:43.300562 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 01:32:43.329928 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 01:32:43.336567 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 01:32:43.389599 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 01:32:43.419306 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 01:32:43.425991 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 01:32:43.962536 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 01:32:43.967371 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 01:32:43.978218 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 01:32:44.022586 tst mo_mt_sms.py: using LAC 25059 01:32:44.140255 tst mo_mt_sms.py: using RAC 69 01:32:44.255710 tst mo_mt_sms.py: using CellId 25059 01:32:44.372101 tst mo_mt_sms.py: using BVCI 25060 01:32:44.478637 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 01:32:44.591896 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 01:32:44.703450 tst mo_mt_sms.py:9: start nitb and bts... 01:32:44.902246 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:32:45.508885 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9083): Launched 01:32:45.806740 run osmo-nitb_10.42.42.2(pid=9084): Launched 01:32:45.992396 run osmo-nitb_10.42.42.2(pid=9084): ERR: Terminated: ERROR {rc=2} [trial-2367↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9084)] 01:32:46.131812 run osmo-nitb_10.42.42.2(pid=9084): stdout: | (launched: 2022-12-10_01:32:45.751901) 01:32:46.279660 run osmo-nitb_10.42.42.2(pid=9084): stderr: | (launched: 2022-12-10_01:32:45.796065) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:32:46.429962 run osmo-nitb_10.42.42.2(pid=9084): stdout: | (launched: 2022-12-10_01:32:45.751901) 01:32:46.569841 run osmo-nitb_10.42.42.2(pid=9084): stderr: | (launched: 2022-12-10_01:32:45.796065) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9084): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9084) [trial-2367↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9084)] 01:32:46.936864 tst osmo-nitb_10.42.42.2(pid=9084): stdout: | (launched: 2022-12-10_01:32:45.751901) 01:32:47.072190 tst osmo-nitb_10.42.42.2(pid=9084): stderr: | (launched: 2022-12-10_01:32:45.796065) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:32:47.229260 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=9084): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9084) [trial-2367↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9084)] [trial-2367↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 01:32:47.239199 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 01:32:47.247510 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9083): Terminating (SIGTERM) 01:32:47.460307 --- ParallelTerminationStrategy: PID 9083 died... 01:32:47.482018 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9083): Terminated: ok {rc=0} 01:32:47.570156 bus /sierra_3: Setting Powered False 01:32:48.671394 bus /sierra_3: Setting Powered False 01:32:49.788926 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 01:32:50.986521 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:32:50.991315 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 01:32:51.022289 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 01:32:51.049701 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 01:32:51.103302 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 01:32:51.133465 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 01:32:51.159933 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 01:32:51.709219 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 01:32:51.715352 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:32:51.727128 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 01:32:51.775545 tst mo_mt_sms.py: using LAC 25060 01:32:51.903274 tst mo_mt_sms.py: using RAC 70 01:32:52.029957 tst mo_mt_sms.py: using CellId 25060 01:32:52.145740 tst mo_mt_sms.py: using BVCI 25061 01:32:52.261534 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:32:52.272738 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:32:52.283825 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:32:52.295005 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:32:52.306214 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:32:52.317349 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 01:32:52.432066 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 01:32:52.548238 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:32:53.043358 run create_hlr_db(pid=9088): Launched 01:32:53.172854 bus /sierra_2: Setting Powered False 01:32:54.236589 run create_hlr_db(pid=9088): Terminated: ok {rc=0} 01:32:54.680086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9090): Launched 01:32:54.998146 run osmo-hlr_10.42.42.2(pid=9091): Launched 01:32:55.121540 run osmo-stp_10.42.42.5: Starting osmo-stp 01:32:55.668761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9093): Launched 01:32:55.987274 run osmo-stp_10.42.42.5(pid=9094): Launched 01:32:56.111566 run osmo-msc_10.42.42.6: Starting osmo-msc 01:32:56.691156 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9096): Launched 01:32:57.011044 run osmo-msc_10.42.42.6(pid=9097): Launched 01:32:57.190655 run osmo-stp_10.42.42.5(pid=9094): ERR: Terminated: ERROR {rc=1} [trial-2367↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9094)] 01:32:57.325622 run osmo-stp_10.42.42.5(pid=9094): stdout: | (launched: 2022-12-10_01:32:55.929009) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:32:57.460140 run osmo-stp_10.42.42.5(pid=9094): stderr: | 20221210013256120 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013256121 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013256121 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013256121 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013256122 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013256122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013256122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:32:57.593670 run osmo-stp_10.42.42.5(pid=9094): stdout: | (launched: 2022-12-10_01:32:55.929009) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:32:57.719933 run osmo-stp_10.42.42.5(pid=9094): stderr: | 20221210013256120 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013256121 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013256121 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013256121 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013256122 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013256122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013256122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:32:57.871173 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=9094): Process ended prematurely: osmo-stp_10.42.42.5(pid=9094) [trial-2367↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9094)] [trial-2367↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 01:32:57.880213 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 01:32:57.907612 run osmo-hlr_10.42.42.2(pid=9091): ERR: Terminated: ERROR {rc=237} [trial-2367↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9091)] 01:32:57.957471 run osmo-hlr_10.42.42.2(pid=9091): stdout: | (launched: 2022-12-10_01:32:54.939816) 01:32:58.009266 run osmo-hlr_10.42.42.2(pid=9091): stderr: | 20221210013255140 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013255140 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013255140 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013255140 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013255140 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013255140 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013255153 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013255161 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013255161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013255161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:32:58.081972 run osmo-msc_10.42.42.6(pid=9097): ERR: Terminated: ERROR {rc=2} [trial-2367↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9097)] 01:32:58.131855 run osmo-msc_10.42.42.6(pid=9097): stdout: | (launched: 2022-12-10_01:32:56.952344) 01:32:58.183435 run osmo-msc_10.42.42.6(pid=9097): stderr: | 20221210013257273 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210013257273 DLGLOBAL DEBUG validating counter group 0x7fdde9ea9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210013257273 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210013257273 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210013257273 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210013257274 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210013257277 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210013257278 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210013257278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210013257278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:32:58.235450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9090): Terminating (SIGTERM) 01:32:58.277112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9093): Terminating (SIGTERM) 01:32:58.318873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9096): Terminating (SIGTERM) 01:32:58.361189 --- ParallelTerminationStrategy: PID 9090 died... 01:32:58.380767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9090): Terminated: ok {rc=0} 01:32:58.427046 --- ParallelTerminationStrategy: PID 9093 died... 01:32:58.446698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9093): Terminated: ok {rc=0} 01:32:58.492481 --- ParallelTerminationStrategy: PID 9096 died... 01:32:58.512059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9096): Terminated: ok {rc=0} 01:32:58.600742 bus /sierra_3: Setting Powered False 01:32:59.700838 bus /sierra_3: Setting Powered False 01:33:00.816410 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 01:33:02.063920 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:33:02.067973 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 01:33:02.101189 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 01:33:02.108925 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 01:33:02.149349 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 01:33:02.181084 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 01:33:02.188890 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 01:33:02.705346 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2367 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 01:33:02.711165 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 01:33:02.722609 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 01:33:02.767900 tst assert_extension.py: using LAC 25061 01:33:02.886541 tst assert_extension.py: using RAC 71 01:33:03.007660 tst assert_extension.py: using CellId 25061 01:33:03.125470 tst assert_extension.py: using BVCI 25062 01:33:03.243190 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 01:33:03.358142 tst assert_extension.py:10: start nitb and bts... 01:33:03.557038 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:33:04.167284 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9103): Launched 01:33:04.465686 run osmo-nitb_10.42.42.2(pid=9104): Launched 01:33:04.632219 run osmo-nitb_10.42.42.2(pid=9104): ERR: Terminated: ERROR {rc=2} [trial-2367↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9104)] 01:33:04.766084 run osmo-nitb_10.42.42.2(pid=9104): stdout: | (launched: 2022-12-10_01:33:04.410671) 01:33:04.901210 run osmo-nitb_10.42.42.2(pid=9104): stderr: | (launched: 2022-12-10_01:33:04.455006) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:33:05.036562 run osmo-nitb_10.42.42.2(pid=9104): stdout: | (launched: 2022-12-10_01:33:04.410671) 01:33:05.166982 run osmo-nitb_10.42.42.2(pid=9104): stderr: | (launched: 2022-12-10_01:33:04.455006) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9104): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9104) [trial-2367↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9104)] 01:33:05.578770 tst osmo-nitb_10.42.42.2(pid=9104): stdout: | (launched: 2022-12-10_01:33:04.410671) 01:33:05.699628 tst osmo-nitb_10.42.42.2(pid=9104): stderr: | (launched: 2022-12-10_01:33:04.455006) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:33:05.841807 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=9104): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9104) [trial-2367↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9104)] [trial-2367↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 01:33:05.850345 tst assert_extension.py:12: Test FAILED (3.1 sec) 01:33:05.857389 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9103): Terminating (SIGTERM) 01:33:06.066526 --- ParallelTerminationStrategy: PID 9103 died... 01:33:06.087430 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9103): Terminated: ok {rc=0} 01:33:06.173819 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 01:33:07.346362 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:33:07.350750 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 01:33:07.380723 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 01:33:07.407191 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 01:33:07.443050 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 01:33:07.472020 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 01:33:07.498442 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 01:33:08.026648 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2367 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 01:33:08.031828 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:33:08.042621 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 01:33:08.090883 tst assert_extension.py: using LAC 25062 01:33:08.207179 tst assert_extension.py: using RAC 72 01:33:08.322963 tst assert_extension.py: using CellId 25062 01:33:08.437663 tst assert_extension.py: using BVCI 25063 01:33:08.553535 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:33:08.564935 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:33:08.576231 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:33:08.587467 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:33:08.598519 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:33:08.609673 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 01:33:08.722590 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:33:09.184161 run create_hlr_db(pid=9108): Launched 01:33:09.299372 bus /sierra_2: Setting Powered False 01:33:10.358744 run create_hlr_db(pid=9108): Terminated: ok {rc=0} 01:33:10.794086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9110): Launched 01:33:11.115656 run osmo-hlr_10.42.42.2(pid=9111): Launched 01:33:11.239110 run osmo-stp_10.42.42.5: Starting osmo-stp 01:33:11.790029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9113): Launched 01:33:12.111650 run osmo-stp_10.42.42.5(pid=9114): Launched 01:33:12.236190 run osmo-msc_10.42.42.6: Starting osmo-msc 01:33:12.811289 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9116): Launched 01:33:13.131696 run osmo-msc_10.42.42.6(pid=9117): Launched 01:33:13.310627 run osmo-stp_10.42.42.5(pid=9114): ERR: Terminated: ERROR {rc=1} [trial-2367↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9114)] 01:33:13.448491 run osmo-stp_10.42.42.5(pid=9114): stdout: | (launched: 2022-12-10_01:33:12.053056) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:33:13.583503 run osmo-stp_10.42.42.5(pid=9114): stderr: | 20221210013312245 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013312246 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013312246 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013312246 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013312247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013312247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013312247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:33:13.717421 run osmo-stp_10.42.42.5(pid=9114): stdout: | (launched: 2022-12-10_01:33:12.053056) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:33:13.844104 run osmo-stp_10.42.42.5(pid=9114): stderr: | 20221210013312245 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013312246 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013312246 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013312246 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013312247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013312247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013312247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:33:13.995542 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=9114): Process ended prematurely: osmo-stp_10.42.42.5(pid=9114) [trial-2367↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9114)] [trial-2367↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 01:33:14.004690 tst assert_extension.py:17: Test FAILED (6.0 sec) 01:33:14.032759 run osmo-hlr_10.42.42.2(pid=9111): ERR: Terminated: ERROR {rc=237} [trial-2367↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9111)] 01:33:14.083060 run osmo-hlr_10.42.42.2(pid=9111): stdout: | (launched: 2022-12-10_01:33:11.056879) 01:33:14.135150 run osmo-hlr_10.42.42.2(pid=9111): stderr: | 20221210013311256 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013311256 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013311256 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013311256 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013311256 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013311256 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013311268 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013311276 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013311277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013311277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:33:14.207638 run osmo-msc_10.42.42.6(pid=9117): ERR: Terminated: ERROR {rc=2} [trial-2367↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9117)] 01:33:14.257728 run osmo-msc_10.42.42.6(pid=9117): stdout: | (launched: 2022-12-10_01:33:13.073516) 01:33:14.309723 run osmo-msc_10.42.42.6(pid=9117): stderr: | 20221210013313393 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210013313393 DLGLOBAL DEBUG validating counter group 0x7f03a72d2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210013313394 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210013313394 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210013313394 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210013313394 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210013313396 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210013313396 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210013313396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210013313396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:33:14.362061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9110): Terminating (SIGTERM) 01:33:14.403869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9113): Terminating (SIGTERM) 01:33:14.445785 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9116): Terminating (SIGTERM) 01:33:14.487873 --- ParallelTerminationStrategy: PID 9110 died... 01:33:14.507702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9110): Terminated: ok {rc=0} 01:33:14.553934 --- ParallelTerminationStrategy: PID 9113 died... 01:33:14.573554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9113): Terminated: ok {rc=0} 01:33:14.619573 --- ParallelTerminationStrategy: PID 9116 died... 01:33:14.639414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9116): Terminated: ok {rc=0} 01:33:14.726638 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 01:33:15.964811 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:33:15.973950 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 01:33:16.007283 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 01:33:16.038748 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 01:33:16.091731 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 01:33:16.122613 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 01:33:16.151029 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 01:33:16.732182 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 01:33:16.801993 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:33:16.816309 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:33:16.895363 tst mo_mt_call.py: using LAC 25063 01:33:17.025022 tst mo_mt_call.py: using RAC 73 01:33:17.154171 tst mo_mt_call.py: using CellId 25063 01:33:17.282958 tst mo_mt_call.py: using BVCI 25064 01:33:17.396847 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:33:17.408410 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:33:17.419685 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:33:17.431685 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:33:17.443785 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:33:17.455708 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:33:17.574909 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:33:17.692564 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:33:18.165420 run create_hlr_db(pid=9122): Launched 01:33:18.283982 bus /sierra_2: Setting Powered False 01:33:19.344245 run create_hlr_db(pid=9122): Terminated: ok {rc=0} 01:33:19.789542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9124): Launched 01:33:20.117664 run osmo-hlr_10.42.42.2(pid=9125): Launched 01:33:20.244650 run osmo-stp_10.42.42.5: Starting osmo-stp 01:33:20.811594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9127): Launched 01:33:21.141500 run osmo-stp_10.42.42.5(pid=9128): Launched 01:33:21.267484 run osmo-msc_10.42.42.6: Starting osmo-msc 01:33:21.858643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9130): Launched 01:33:22.186974 run osmo-msc_10.42.42.6(pid=9131): Launched 01:33:22.370263 run osmo-stp_10.42.42.5(pid=9128): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9128)] 01:33:22.507297 run osmo-stp_10.42.42.5(pid=9128): stdout: | (launched: 2022-12-10_01:33:21.081384) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:33:22.643980 run osmo-stp_10.42.42.5(pid=9128): stderr: | 20221210013321276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013321277 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013321277 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013321277 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013321278 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013321278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013321278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:33:22.780516 run osmo-stp_10.42.42.5(pid=9128): stdout: | (launched: 2022-12-10_01:33:21.081384) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:33:22.909951 run osmo-stp_10.42.42.5(pid=9128): stderr: | 20221210013321276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013321277 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013321277 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013321277 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013321278 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013321278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013321278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:33:23.065404 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9128): Process ended prematurely: osmo-stp_10.42.42.5(pid=9128) [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9128)] [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 01:33:23.074950 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 01:33:23.103227 run osmo-hlr_10.42.42.2(pid=9125): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9125)] 01:33:23.153435 run osmo-hlr_10.42.42.2(pid=9125): stdout: | (launched: 2022-12-10_01:33:20.057627) 01:33:23.205122 run osmo-hlr_10.42.42.2(pid=9125): stderr: | 20221210013320258 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013320258 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013320258 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013320258 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013320258 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013320258 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013320270 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013320280 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013320280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013320280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:33:23.277522 run osmo-msc_10.42.42.6(pid=9131): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9131)] 01:33:23.327369 run osmo-msc_10.42.42.6(pid=9131): stdout: | (launched: 2022-12-10_01:33:22.127478) 01:33:23.378665 run osmo-msc_10.42.42.6(pid=9131): stderr: | 20221210013322449 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210013322449 DLGLOBAL DEBUG validating counter group 0x7fa75ed50c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210013322450 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210013322450 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210013322450 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210013322450 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210013322452 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210013322452 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210013322452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210013322452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:33:23.430384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9124): Terminating (SIGTERM) 01:33:23.471757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9127): Terminating (SIGTERM) 01:33:23.513510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9130): Terminating (SIGTERM) 01:33:23.555284 --- ParallelTerminationStrategy: PID 9124 died... 01:33:23.575124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9124): Terminated: ok {rc=0} 01:33:23.621095 --- ParallelTerminationStrategy: PID 9127 died... 01:33:23.640939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9127): Terminated: ok {rc=0} 01:33:23.686719 --- ParallelTerminationStrategy: PID 9130 died... 01:33:23.706227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9130): Terminated: ok {rc=0} 01:33:23.794601 bus /sierra_3: Setting Powered False 01:33:24.894131 bus /sierra_3: Setting Powered False 01:33:26.009459 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 01:33:27.159487 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:33:27.171971 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:33:27.240058 tst mo_mt_call_osmux.py: using LAC 25064 01:33:27.367882 tst mo_mt_call_osmux.py: using RAC 74 01:33:27.494731 tst mo_mt_call_osmux.py: using CellId 25064 01:33:27.623765 tst mo_mt_call_osmux.py: using BVCI 25065 01:33:27.741363 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:33:27.753229 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:33:27.764750 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:33:27.776464 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:33:27.788197 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:33:27.799721 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:33:27.916318 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:33:28.030162 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:33:28.502063 run create_hlr_db(pid=9133): Launched 01:33:28.638223 bus /sierra_2: Setting Powered False 01:33:29.702814 run create_hlr_db(pid=9133): Terminated: ok {rc=0} 01:33:30.154276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9135): Launched 01:33:30.482017 run osmo-hlr_10.42.42.2(pid=9136): Launched 01:33:30.605710 run osmo-stp_10.42.42.5: Starting osmo-stp 01:33:31.175144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9138): Launched 01:33:31.503983 run osmo-stp_10.42.42.5(pid=9139): Launched 01:33:31.786662 run osmo-msc_10.42.42.6: Starting osmo-msc 01:33:32.461614 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9141): Launched 01:33:32.769690 run osmo-msc_10.42.42.6(pid=9142): Launched 01:33:32.941841 run osmo-stp_10.42.42.5(pid=9139): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9139)] 01:33:33.072051 run osmo-stp_10.42.42.5(pid=9139): stdout: | (launched: 2022-12-10_01:33:31.444146) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:33:33.201205 run osmo-stp_10.42.42.5(pid=9139): stderr: | 20221210013331710 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013331711 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013331714 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013331717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013331717 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013331718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013331718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:33:33.329136 run osmo-stp_10.42.42.5(pid=9139): stdout: | (launched: 2022-12-10_01:33:31.444146) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:33:33.451499 run osmo-stp_10.42.42.5(pid=9139): stderr: | 20221210013331710 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013331711 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013331714 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013331717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013331717 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013331718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013331718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:33:33.598077 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9139): Process ended prematurely: osmo-stp_10.42.42.5(pid=9139) [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9139)] [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 01:33:33.607131 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 01:33:33.635620 run osmo-hlr_10.42.42.2(pid=9136): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9136)] 01:33:33.684191 run osmo-hlr_10.42.42.2(pid=9136): stdout: | (launched: 2022-12-10_01:33:30.422060) 01:33:33.734647 run osmo-hlr_10.42.42.2(pid=9136): stderr: | 20221210013330624 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013330624 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013330624 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013330624 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013330624 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013330624 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013330637 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013330645 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013330645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013330645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:33:33.804555 run osmo-msc_10.42.42.6(pid=9142): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9142)] 01:33:33.853319 run osmo-msc_10.42.42.6(pid=9142): stdout: | (launched: 2022-12-10_01:33:32.713174) 01:33:33.903388 run osmo-msc_10.42.42.6(pid=9142): stderr: | 20221210013332988 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210013332988 DLGLOBAL DEBUG validating counter group 0x7f1aa3e94c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210013332988 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210013332988 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210013332988 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210013332988 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210013332990 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210013332991 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210013332991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210013332991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:33:33.954275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9135): Terminating (SIGTERM) 01:33:33.994842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9138): Terminating (SIGTERM) 01:33:34.035647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9141): Terminating (SIGTERM) 01:33:34.076399 --- ParallelTerminationStrategy: PID 9135 died... 01:33:34.095779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9135): Terminated: ok {rc=0} 01:33:34.141569 --- ParallelTerminationStrategy: PID 9138 died... 01:33:34.160417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9138): Terminated: ok {rc=0} 01:33:34.206024 --- ParallelTerminationStrategy: PID 9141 died... 01:33:34.224632 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9141): Terminated: ok {rc=0} 01:33:34.309783 bus /sierra_3: Setting Powered False 01:33:35.405795 bus /sierra_3: Setting Powered False 01:33:36.520479 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 01:33:37.766327 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:33:37.772585 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 01:33:37.802785 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 01:33:37.829272 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 01:33:37.882307 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 01:33:37.912805 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 01:33:37.939085 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 01:33:38.488198 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 01:33:38.537994 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:33:38.549444 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:33:38.617559 tst mo_mt_call.py: using LAC 25065 01:33:38.735920 tst mo_mt_call.py: using RAC 75 01:33:38.853327 tst mo_mt_call.py: using CellId 25065 01:33:38.970526 tst mo_mt_call.py: using BVCI 25066 01:33:39.080299 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:33:39.091639 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:33:39.102962 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:33:39.114425 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:33:39.126065 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:33:39.137439 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:33:39.259776 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:33:39.380455 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:33:39.884314 run create_hlr_db(pid=9147): Launched 01:33:40.018153 bus /sierra_2: Setting Powered False 01:33:41.083053 run create_hlr_db(pid=9147): Terminated: ok {rc=0} 01:33:41.516743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9149): Launched 01:33:41.821063 run osmo-hlr_10.42.42.2(pid=9150): Launched 01:33:41.938461 run osmo-stp_10.42.42.5: Starting osmo-stp 01:33:42.461144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9152): Launched 01:33:42.767211 run osmo-stp_10.42.42.5(pid=9153): Launched 01:33:42.884000 run osmo-msc_10.42.42.6: Starting osmo-msc 01:33:43.434225 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9155): Launched 01:33:43.738439 run osmo-msc_10.42.42.6(pid=9156): Launched 01:33:43.908740 run osmo-stp_10.42.42.5(pid=9153): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9153)] 01:33:44.038127 run osmo-stp_10.42.42.5(pid=9153): stdout: | (launched: 2022-12-10_01:33:42.710783) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:33:44.166983 run osmo-stp_10.42.42.5(pid=9153): stderr: | 20221210013342882 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013342882 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013342882 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013342882 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013342883 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013342883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013342883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:33:44.293514 run osmo-stp_10.42.42.5(pid=9153): stdout: | (launched: 2022-12-10_01:33:42.710783) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:33:44.414474 run osmo-stp_10.42.42.5(pid=9153): stderr: | 20221210013342882 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013342882 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013342882 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013342882 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013342883 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013342883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013342883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:33:44.559782 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9153): Process ended prematurely: osmo-stp_10.42.42.5(pid=9153) [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9153)] [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 01:33:44.568816 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:33:44.596200 run osmo-hlr_10.42.42.2(pid=9150): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9150)] 01:33:44.643914 run osmo-hlr_10.42.42.2(pid=9150): stdout: | (launched: 2022-12-10_01:33:41.765112) 01:33:44.693289 run osmo-hlr_10.42.42.2(pid=9150): stderr: | 20221210013341945 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013341945 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013341945 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013341945 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013341945 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013341945 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013341956 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013341966 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013341966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013341966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:33:44.762045 run osmo-msc_10.42.42.6(pid=9156): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9156)] 01:33:44.809655 run osmo-msc_10.42.42.6(pid=9156): stdout: | (launched: 2022-12-10_01:33:43.682476) 01:33:44.858653 run osmo-msc_10.42.42.6(pid=9156): stderr: | 20221210013343953 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210013343953 DLGLOBAL DEBUG validating counter group 0x7ff20a079c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210013343953 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210013343953 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210013343953 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210013343954 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210013343957 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210013343958 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210013343958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210013343958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:33:44.908167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9149): Terminating (SIGTERM) 01:33:44.948148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9152): Terminating (SIGTERM) 01:33:44.987683 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9155): Terminating (SIGTERM) 01:33:45.027548 --- ParallelTerminationStrategy: PID 9149 died... 01:33:45.046611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9149): Terminated: ok {rc=0} 01:33:45.090607 --- ParallelTerminationStrategy: PID 9152 died... 01:33:45.109226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9152): Terminated: ok {rc=0} 01:33:45.153306 --- ParallelTerminationStrategy: PID 9155 died... 01:33:45.172004 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9155): Terminated: ok {rc=0} 01:33:45.257165 bus /sierra_3: Setting Powered False 01:33:46.378992 bus /sierra_3: Setting Powered False 01:33:47.498549 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 01:33:48.642720 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:33:48.654878 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:33:48.720263 tst mo_mt_call_osmux.py: using LAC 25066 01:33:48.838183 tst mo_mt_call_osmux.py: using RAC 76 01:33:48.957089 tst mo_mt_call_osmux.py: using CellId 25066 01:33:49.076764 tst mo_mt_call_osmux.py: using BVCI 25067 01:33:49.186451 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:33:49.197828 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:33:49.208756 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:33:49.220014 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:33:49.231292 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:33:49.242481 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:33:49.354362 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:33:49.474002 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:33:49.937768 run create_hlr_db(pid=9158): Launched 01:33:50.053247 bus /sierra_2: Setting Powered False 01:33:51.112884 run create_hlr_db(pid=9158): Terminated: ok {rc=0} 01:33:51.551871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9160): Launched 01:33:51.873688 run osmo-hlr_10.42.42.2(pid=9161): Launched 01:33:51.996601 run osmo-stp_10.42.42.5: Starting osmo-stp 01:33:52.547253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9163): Launched 01:33:52.869272 run osmo-stp_10.42.42.5(pid=9164): Launched 01:33:52.991441 run osmo-msc_10.42.42.6: Starting osmo-msc 01:33:53.572216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9166): Launched 01:33:53.892910 run osmo-msc_10.42.42.6(pid=9167): Launched 01:33:54.073053 run osmo-stp_10.42.42.5(pid=9164): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9164)] 01:33:54.207922 run osmo-stp_10.42.42.5(pid=9164): stdout: | (launched: 2022-12-10_01:33:52.810608) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:33:54.343242 run osmo-stp_10.42.42.5(pid=9164): stderr: | 20221210013353003 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013353004 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013353004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013353004 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013353005 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013353005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013353005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:33:54.479029 run osmo-stp_10.42.42.5(pid=9164): stdout: | (launched: 2022-12-10_01:33:52.810608) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:33:54.606367 run osmo-stp_10.42.42.5(pid=9164): stderr: | 20221210013353003 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013353004 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013353004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013353004 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013353005 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013353005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013353005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:33:54.759076 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9164): Process ended prematurely: osmo-stp_10.42.42.5(pid=9164) [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9164)] [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 01:33:54.768752 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 01:33:54.796601 run osmo-hlr_10.42.42.2(pid=9161): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9161)] 01:33:54.846528 run osmo-hlr_10.42.42.2(pid=9161): stdout: | (launched: 2022-12-10_01:33:51.814904) 01:33:54.897783 run osmo-hlr_10.42.42.2(pid=9161): stderr: | 20221210013352014 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013352014 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013352014 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013352014 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013352014 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013352015 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013352031 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013352041 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013352041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013352041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:33:54.969357 run osmo-msc_10.42.42.6(pid=9167): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9167)] 01:33:55.018738 run osmo-msc_10.42.42.6(pid=9167): stdout: | (launched: 2022-12-10_01:33:53.834081) 01:33:55.070135 run osmo-msc_10.42.42.6(pid=9167): stderr: | 20221210013354155 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210013354155 DLGLOBAL DEBUG validating counter group 0x7f1a96d37c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210013354155 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210013354155 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210013354156 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210013354156 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210013354157 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210013354158 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210013354158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210013354158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:33:55.121962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9160): Terminating (SIGTERM) 01:33:55.163351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9163): Terminating (SIGTERM) 01:33:55.204829 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9166): Terminating (SIGTERM) 01:33:55.246642 --- ParallelTerminationStrategy: PID 9160 died... 01:33:55.266418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9160): Terminated: ok {rc=0} 01:33:55.312268 --- ParallelTerminationStrategy: PID 9163 died... 01:33:55.332076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9163): Terminated: ok {rc=0} 01:33:55.377848 --- ParallelTerminationStrategy: PID 9166 died... 01:33:55.397425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9166): Terminated: ok {rc=0} 01:33:55.484012 bus /sierra_3: Setting Powered False 01:33:56.580473 bus /sierra_3: Setting Powered False 01:33:57.694073 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 01:33:58.933202 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:33:58.939408 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 01:33:58.968489 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 01:33:58.994936 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 01:33:59.045751 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 01:33:59.074362 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 01:33:59.100171 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 01:33:59.653217 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 01:33:59.701402 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:33:59.712513 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:33:59.776193 tst mo_mt_call.py: using LAC 25067 01:33:59.890819 tst mo_mt_call.py: using RAC 77 01:34:00.006834 tst mo_mt_call.py: using CellId 25067 01:34:00.121130 tst mo_mt_call.py: using BVCI 25068 01:34:00.226554 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:00.237945 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:00.249007 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:00.260243 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:00.271686 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:00.282907 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:34:00.397894 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:34:00.509638 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:34:00.984175 run create_hlr_db(pid=9172): Launched 01:34:01.130932 bus /sierra_2: Setting Powered False 01:34:02.195909 run create_hlr_db(pid=9172): Terminated: ok {rc=0} 01:34:02.607484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9174): Launched 01:34:02.901514 run osmo-hlr_10.42.42.2(pid=9175): Launched 01:34:03.014466 run osmo-stp_10.42.42.5: Starting osmo-stp 01:34:03.529402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9177): Launched 01:34:03.823930 run osmo-stp_10.42.42.5(pid=9178): Launched 01:34:03.936408 run osmo-msc_10.42.42.6: Starting osmo-msc 01:34:04.469817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9180): Launched 01:34:04.765472 run osmo-msc_10.42.42.6(pid=9181): Launched 01:34:04.931614 run osmo-stp_10.42.42.5(pid=9178): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9178)] 01:34:05.057413 run osmo-stp_10.42.42.5(pid=9178): stdout: | (launched: 2022-12-10_01:34:03.770011) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:34:05.183109 run osmo-stp_10.42.42.5(pid=9178): stderr: | 20221210013403935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013403936 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013403936 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013403936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013403937 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013403937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013403937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:34:05.306182 run osmo-stp_10.42.42.5(pid=9178): stdout: | (launched: 2022-12-10_01:34:03.770011) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:34:05.423390 run osmo-stp_10.42.42.5(pid=9178): stderr: | 20221210013403935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013403936 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013403936 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013403936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013403937 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013403937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013403937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:34:05.564375 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9178): Process ended prematurely: osmo-stp_10.42.42.5(pid=9178) [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9178)] [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 01:34:05.573980 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 01:34:05.601107 run osmo-hlr_10.42.42.2(pid=9175): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9175)] 01:34:05.647954 run osmo-hlr_10.42.42.2(pid=9175): stdout: | (launched: 2022-12-10_01:34:02.847037) 01:34:05.696586 run osmo-hlr_10.42.42.2(pid=9175): stderr: | 20221210013403019 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013403019 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013403019 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013403019 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013403019 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013403019 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013403031 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013403039 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013403039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013403040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:34:05.764242 run osmo-msc_10.42.42.6(pid=9181): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9181)] 01:34:05.811439 run osmo-msc_10.42.42.6(pid=9181): stdout: | (launched: 2022-12-10_01:34:04.711266) 01:34:05.860466 run osmo-msc_10.42.42.6(pid=9181): stderr: | 20221210013404979 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210013404979 DLGLOBAL DEBUG validating counter group 0x7fd84aef3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210013404979 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210013404980 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210013404980 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210013404980 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210013404982 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210013404982 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210013404982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210013404982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:34:05.909555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9174): Terminating (SIGTERM) 01:34:05.948601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9177): Terminating (SIGTERM) 01:34:05.987649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9180): Terminating (SIGTERM) 01:34:06.026814 --- ParallelTerminationStrategy: PID 9174 died... 01:34:06.045611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9174): Terminated: ok {rc=0} 01:34:06.089216 --- ParallelTerminationStrategy: PID 9177 died... 01:34:06.107575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9177): Terminated: ok {rc=0} 01:34:06.150779 --- ParallelTerminationStrategy: PID 9180 died... 01:34:06.169115 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9180): Terminated: ok {rc=0} 01:34:06.253154 bus /sierra_3: Setting Powered False 01:34:07.351258 bus /sierra_3: Setting Powered False 01:34:08.464794 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 01:34:09.610524 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:09.622800 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:34:09.696376 tst mo_mt_call_osmux.py: using LAC 25068 01:34:09.820519 tst mo_mt_call_osmux.py: using RAC 78 01:34:09.942319 tst mo_mt_call_osmux.py: using CellId 25068 01:34:10.064771 tst mo_mt_call_osmux.py: using BVCI 25069 01:34:10.178999 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:10.190786 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:10.202406 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:10.213761 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:10.225343 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:10.236695 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:34:10.353809 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:34:10.468874 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:34:10.926555 run create_hlr_db(pid=9183): Launched 01:34:11.039972 bus /sierra_2: Setting Powered False 01:34:12.099375 run create_hlr_db(pid=9183): Terminated: ok {rc=0} 01:34:12.507303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9185): Launched 01:34:12.800517 run osmo-hlr_10.42.42.2(pid=9186): Launched 01:34:12.912326 run osmo-stp_10.42.42.5: Starting osmo-stp 01:34:13.429530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9188): Launched 01:34:13.724446 run osmo-stp_10.42.42.5(pid=9189): Launched 01:34:13.837388 run osmo-msc_10.42.42.6: Starting osmo-msc 01:34:14.366915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9191): Launched 01:34:14.660245 run osmo-msc_10.42.42.6(pid=9192): Launched 01:34:14.826728 run osmo-stp_10.42.42.5(pid=9189): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9189)] 01:34:14.951554 run osmo-stp_10.42.42.5(pid=9189): stdout: | (launched: 2022-12-10_01:34:13.670498) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:34:15.075862 run osmo-stp_10.42.42.5(pid=9189): stderr: | 20221210013413835 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013413835 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013413836 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013413836 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013413836 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013413837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013413837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:34:15.197659 run osmo-stp_10.42.42.5(pid=9189): stdout: | (launched: 2022-12-10_01:34:13.670498) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:34:15.314416 run osmo-stp_10.42.42.5(pid=9189): stderr: | 20221210013413835 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013413835 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013413836 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013413836 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013413836 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013413837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013413837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:34:15.454411 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9189): Process ended prematurely: osmo-stp_10.42.42.5(pid=9189) [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9189)] [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 01:34:15.462955 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 01:34:15.489516 run osmo-hlr_10.42.42.2(pid=9186): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9186)] 01:34:15.536251 run osmo-hlr_10.42.42.2(pid=9186): stdout: | (launched: 2022-12-10_01:34:12.746500) 01:34:15.584873 run osmo-hlr_10.42.42.2(pid=9186): stderr: | 20221210013412919 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013412919 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013412919 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013412919 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013412919 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013412919 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013412931 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013412940 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013412940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013412940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:34:15.652558 run osmo-msc_10.42.42.6(pid=9192): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9192)] 01:34:15.699585 run osmo-msc_10.42.42.6(pid=9192): stdout: | (launched: 2022-12-10_01:34:14.606268) 01:34:15.748035 run osmo-msc_10.42.42.6(pid=9192): stderr: | 20221210013414876 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210013414877 DLGLOBAL DEBUG validating counter group 0x7f45cc457c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210013414877 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210013414877 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210013414877 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210013414877 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210013414880 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210013414880 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210013414880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210013414880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:34:15.796916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9185): Terminating (SIGTERM) 01:34:15.836741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9188): Terminating (SIGTERM) 01:34:15.892378 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9191): Terminating (SIGTERM) 01:34:15.933633 --- ParallelTerminationStrategy: PID 9185 died... 01:34:15.952588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9185): Terminated: ok {rc=0} 01:34:15.998461 --- ParallelTerminationStrategy: PID 9188 died... 01:34:16.017625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9188): Terminated: ok {rc=0} 01:34:16.063033 --- ParallelTerminationStrategy: PID 9191 died... 01:34:16.082362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9191): Terminated: ok {rc=0} 01:34:16.168180 bus /sierra_3: Setting Powered False 01:34:17.268460 bus /sierra_3: Setting Powered False 01:34:18.381616 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 01:34:19.625786 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:34:19.632513 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 01:34:19.662263 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 01:34:19.689748 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 01:34:19.743157 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 01:34:19.772663 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 01:34:19.799459 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 01:34:20.351088 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 01:34:20.401574 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:34:20.413106 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 01:34:20.478772 tst mo_mt_call.py: using LAC 25069 01:34:20.601392 tst mo_mt_call.py: using RAC 79 01:34:20.726765 tst mo_mt_call.py: using CellId 25069 01:34:20.849367 tst mo_mt_call.py: using BVCI 25070 01:34:20.962970 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:34:20.974447 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:34:20.985795 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:34:20.997112 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:34:21.008394 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:34:21.019667 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:34:21.131619 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:34:21.248285 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:34:21.737189 run create_hlr_db(pid=9197): Launched 01:34:21.866228 bus /sierra_2: Setting Powered False 01:34:22.929459 run create_hlr_db(pid=9197): Terminated: ok {rc=0} 01:34:23.365891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9199): Launched 01:34:23.681438 run osmo-hlr_10.42.42.2(pid=9200): Launched 01:34:23.802486 run osmo-stp_10.42.42.5: Starting osmo-stp 01:34:24.350499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9202): Launched 01:34:24.664260 run osmo-stp_10.42.42.5(pid=9203): Launched 01:34:24.784641 run osmo-msc_10.42.42.6: Starting osmo-msc 01:34:25.354491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9205): Launched 01:34:25.670642 run osmo-msc_10.42.42.6(pid=9206): Launched 01:34:25.847702 run osmo-stp_10.42.42.5(pid=9203): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9203)] 01:34:25.981106 run osmo-stp_10.42.42.5(pid=9203): stdout: | (launched: 2022-12-10_01:34:24.607045) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:34:26.114873 run osmo-stp_10.42.42.5(pid=9203): stderr: | 20221210013424796 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013424797 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013424797 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013424797 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013424798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013424798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013424798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:34:26.247027 run osmo-stp_10.42.42.5(pid=9203): stdout: | (launched: 2022-12-10_01:34:24.607045) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:34:26.372501 run osmo-stp_10.42.42.5(pid=9203): stderr: | 20221210013424796 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013424797 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013424797 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013424797 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013424798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013424798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013424798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:34:26.522938 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9203): Process ended prematurely: osmo-stp_10.42.42.5(pid=9203) [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9203)] [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 01:34:26.532226 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 01:34:26.559708 run osmo-hlr_10.42.42.2(pid=9200): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9200)] 01:34:26.608751 run osmo-hlr_10.42.42.2(pid=9200): stdout: | (launched: 2022-12-10_01:34:23.623856) 01:34:26.659567 run osmo-hlr_10.42.42.2(pid=9200): stderr: | 20221210013423819 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013423819 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013423819 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013423819 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013423819 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013423819 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013423831 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013423840 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013423840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013423840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:34:26.730657 run osmo-msc_10.42.42.6(pid=9206): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9206)] 01:34:26.779668 run osmo-msc_10.42.42.6(pid=9206): stdout: | (launched: 2022-12-10_01:34:25.612516) 01:34:26.830501 run osmo-msc_10.42.42.6(pid=9206): stderr: | 20221210013425933 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210013425933 DLGLOBAL DEBUG validating counter group 0x7f0e34659c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210013425933 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210013425933 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210013425934 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210013425934 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210013425935 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210013425936 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210013425936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210013425936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:34:26.881618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9199): Terminating (SIGTERM) 01:34:26.922337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9202): Terminating (SIGTERM) 01:34:26.963342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9205): Terminating (SIGTERM) 01:34:27.004431 --- ParallelTerminationStrategy: PID 9199 died... 01:34:27.023833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9199): Terminated: ok {rc=0} 01:34:27.069463 --- ParallelTerminationStrategy: PID 9202 died... 01:34:27.088617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9202): Terminated: ok {rc=0} 01:34:27.134113 --- ParallelTerminationStrategy: PID 9205 died... 01:34:27.153391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9205): Terminated: ok {rc=0} 01:34:27.239263 bus /sierra_3: Setting Powered False 01:34:28.337471 bus /sierra_3: Setting Powered False 01:34:29.450435 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 01:34:30.596311 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:34:30.608427 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 01:34:30.674476 tst mo_mt_call_osmux.py: using LAC 25070 01:34:30.797820 tst mo_mt_call_osmux.py: using RAC 80 01:34:30.952117 tst mo_mt_call_osmux.py: using CellId 25070 01:34:31.077928 tst mo_mt_call_osmux.py: using BVCI 25071 01:34:31.190220 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:34:31.202304 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:34:31.214362 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:34:31.226762 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:34:31.239365 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:34:31.252397 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:34:31.368875 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:34:31.484275 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:34:32.049684 run create_hlr_db(pid=9208): Launched 01:34:32.209876 bus /sierra_2: Setting Powered False 01:34:33.273080 run create_hlr_db(pid=9208): Terminated: ok {rc=0} 01:34:33.711501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9210): Launched 01:34:34.027516 run osmo-hlr_10.42.42.2(pid=9211): Launched 01:34:34.148379 run osmo-stp_10.42.42.5: Starting osmo-stp 01:34:34.689475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9213): Launched 01:34:35.005288 run osmo-stp_10.42.42.5(pid=9214): Launched 01:34:35.126473 run osmo-msc_10.42.42.6: Starting osmo-msc 01:34:35.696898 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9216): Launched 01:34:36.011268 run osmo-msc_10.42.42.6(pid=9217): Launched 01:34:36.187681 run osmo-stp_10.42.42.5(pid=9214): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9214)] 01:34:36.319886 run osmo-stp_10.42.42.5(pid=9214): stdout: | (launched: 2022-12-10_01:34:34.947369) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:34:36.453476 run osmo-stp_10.42.42.5(pid=9214): stderr: | 20221210013435139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013435139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013435140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013435140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013435140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013435141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013435141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:34:36.585491 run osmo-stp_10.42.42.5(pid=9214): stdout: | (launched: 2022-12-10_01:34:34.947369) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:34:36.711086 run osmo-stp_10.42.42.5(pid=9214): stderr: | 20221210013435139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013435139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013435140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013435140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013435140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013435141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013435141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:34:36.861333 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9214): Process ended prematurely: osmo-stp_10.42.42.5(pid=9214) [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9214)] [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 01:34:36.870495 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 01:34:36.898058 run osmo-hlr_10.42.42.2(pid=9211): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9211)] 01:34:36.947927 run osmo-hlr_10.42.42.2(pid=9211): stdout: | (launched: 2022-12-10_01:34:33.970021) 01:34:36.999179 run osmo-hlr_10.42.42.2(pid=9211): stderr: | 20221210013434165 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013434165 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013434165 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013434165 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013434165 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013434165 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013434180 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013434188 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013434189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013434189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:34:37.071329 run osmo-msc_10.42.42.6(pid=9217): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9217)] 01:34:37.121314 run osmo-msc_10.42.42.6(pid=9217): stdout: | (launched: 2022-12-10_01:34:35.953806) 01:34:37.172516 run osmo-msc_10.42.42.6(pid=9217): stderr: | 20221210013436273 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210013436273 DLGLOBAL DEBUG validating counter group 0x7fdf71519c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210013436273 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210013436273 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210013436274 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210013436274 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210013436275 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210013436276 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210013436276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210013436276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:34:37.223990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9210): Terminating (SIGTERM) 01:34:37.265071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9213): Terminating (SIGTERM) 01:34:37.306205 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9216): Terminating (SIGTERM) 01:34:37.347752 --- ParallelTerminationStrategy: PID 9210 died... 01:34:37.367500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9210): Terminated: ok {rc=0} 01:34:37.412910 --- ParallelTerminationStrategy: PID 9213 died... 01:34:37.432293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9213): Terminated: ok {rc=0} 01:34:37.478109 --- ParallelTerminationStrategy: PID 9216 died... 01:34:37.497663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9216): Terminated: ok {rc=0} 01:34:37.584116 bus /sierra_3: Setting Powered False 01:34:38.682197 bus /sierra_3: Setting Powered False 01:34:39.796464 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 01:34:41.039140 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:34:41.047427 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 01:34:41.077269 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 01:34:41.104002 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 01:34:41.157541 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 01:34:41.187129 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 01:34:41.213492 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 01:34:41.768326 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 01:34:41.818715 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:34:41.830188 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:34:41.898951 tst mo_mt_call.py: using LAC 25071 01:34:42.014488 tst mo_mt_call.py: using RAC 81 01:34:42.131735 tst mo_mt_call.py: using CellId 25071 01:34:42.245741 tst mo_mt_call.py: using BVCI 25072 01:34:42.352149 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:34:42.363417 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:34:42.374508 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:34:42.386030 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:34:42.396843 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:34:42.408446 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:34:42.522867 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:34:42.635278 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:34:43.091380 run create_hlr_db(pid=9222): Launched 01:34:43.203540 bus /sierra_2: Setting Powered False 01:34:44.262245 run create_hlr_db(pid=9222): Terminated: ok {rc=0} 01:34:44.692617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9224): Launched 01:34:45.007801 run osmo-hlr_10.42.42.2(pid=9225): Launched 01:34:45.129573 run osmo-stp_10.42.42.5: Starting osmo-stp 01:34:45.670416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9227): Launched 01:34:46.006847 run osmo-stp_10.42.42.5(pid=9228): Launched 01:34:46.273099 run osmo-msc_10.42.42.6: Starting osmo-msc 01:34:46.975174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9230): Launched 01:34:47.315806 run osmo-msc_10.42.42.6(pid=9231): Launched 01:34:47.508201 run osmo-stp_10.42.42.5(pid=9228): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9228)] 01:34:47.640594 run osmo-stp_10.42.42.5(pid=9228): stdout: | (launched: 2022-12-10_01:34:45.947780) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:34:47.774112 run osmo-stp_10.42.42.5(pid=9228): stderr: | 20221210013446307 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013446307 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013446310 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013446311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013446312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013446312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013446313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:34:47.906129 run osmo-stp_10.42.42.5(pid=9228): stdout: | (launched: 2022-12-10_01:34:45.947780) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:34:48.032155 run osmo-stp_10.42.42.5(pid=9228): stderr: | 20221210013446307 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013446307 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013446310 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013446311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013446312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013446312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013446313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:34:48.183056 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9228): Process ended prematurely: osmo-stp_10.42.42.5(pid=9228) [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9228)] [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 01:34:48.192324 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 01:34:48.219919 run osmo-hlr_10.42.42.2(pid=9225): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9225)] 01:34:48.268887 run osmo-hlr_10.42.42.2(pid=9225): stdout: | (launched: 2022-12-10_01:34:44.950701) 01:34:48.319879 run osmo-hlr_10.42.42.2(pid=9225): stderr: | 20221210013445144 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013445144 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013445144 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013445144 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013445144 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013445144 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013445158 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013445166 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013445166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013445166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:34:48.390741 run osmo-msc_10.42.42.6(pid=9231): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9231)] 01:34:48.439731 run osmo-msc_10.42.42.6(pid=9231): stdout: | (launched: 2022-12-10_01:34:47.243349) 01:34:48.490279 run osmo-msc_10.42.42.6(pid=9231): stderr: | 20221210013447586 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210013447586 DLGLOBAL DEBUG validating counter group 0x7fb125ca1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210013447586 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210013447586 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210013447586 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210013447586 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210013447588 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210013447588 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210013447589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210013447589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:34:48.541268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9224): Terminating (SIGTERM) 01:34:48.582243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9227): Terminating (SIGTERM) 01:34:48.623392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9230): Terminating (SIGTERM) 01:34:48.664622 --- ParallelTerminationStrategy: PID 9224 died... 01:34:48.684427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9224): Terminated: ok {rc=0} 01:34:48.729844 --- ParallelTerminationStrategy: PID 9227 died... 01:34:48.749156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9227): Terminated: ok {rc=0} 01:34:48.794270 --- ParallelTerminationStrategy: PID 9230 died... 01:34:48.813583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9230): Terminated: ok {rc=0} 01:34:48.899612 bus /sierra_3: Setting Powered False 01:34:49.997826 bus /sierra_3: Setting Powered False 01:34:51.111486 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 01:34:52.257187 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:34:52.269430 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:34:52.336586 tst mo_mt_call_osmux.py: using LAC 25072 01:34:52.461963 tst mo_mt_call_osmux.py: using RAC 82 01:34:52.585570 tst mo_mt_call_osmux.py: using CellId 25072 01:34:52.702781 tst mo_mt_call_osmux.py: using BVCI 25073 01:34:52.819599 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:34:52.831117 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:34:52.842576 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:34:52.853961 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:34:52.865461 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:34:52.876721 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:34:52.994138 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:34:53.108684 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:34:53.564731 run create_hlr_db(pid=9233): Launched 01:34:53.678208 bus /sierra_2: Setting Powered False 01:34:54.737585 run create_hlr_db(pid=9233): Terminated: ok {rc=0} 01:34:55.168709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9235): Launched 01:34:55.484800 run osmo-hlr_10.42.42.2(pid=9236): Launched 01:34:55.606389 run osmo-stp_10.42.42.5: Starting osmo-stp 01:34:56.156207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9238): Launched 01:34:56.471924 run osmo-stp_10.42.42.5(pid=9239): Launched 01:34:56.593205 run osmo-msc_10.42.42.6: Starting osmo-msc 01:34:57.164377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9241): Launched 01:34:57.480627 run osmo-msc_10.42.42.6(pid=9242): Launched 01:34:57.658516 run osmo-stp_10.42.42.5(pid=9239): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9239)] 01:34:57.792214 run osmo-stp_10.42.42.5(pid=9239): stdout: | (launched: 2022-12-10_01:34:56.414398) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:34:57.926181 run osmo-stp_10.42.42.5(pid=9239): stderr: | 20221210013456605 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013456605 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013456605 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013456605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013456606 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013456606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013456606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:34:58.059708 run osmo-stp_10.42.42.5(pid=9239): stdout: | (launched: 2022-12-10_01:34:56.414398) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:34:58.186469 run osmo-stp_10.42.42.5(pid=9239): stderr: | 20221210013456605 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013456605 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013456605 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013456605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013456606 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013456606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013456606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:34:58.337576 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9239): Process ended prematurely: osmo-stp_10.42.42.5(pid=9239) [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9239)] [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 01:34:58.347089 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 01:34:58.374692 run osmo-hlr_10.42.42.2(pid=9236): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9236)] 01:34:58.424076 run osmo-hlr_10.42.42.2(pid=9236): stdout: | (launched: 2022-12-10_01:34:55.427275) 01:34:58.475194 run osmo-hlr_10.42.42.2(pid=9236): stderr: | 20221210013455622 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013455622 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013455622 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013455622 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013455622 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013455623 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013455635 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013455643 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013455643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013455643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:34:58.546860 run osmo-msc_10.42.42.6(pid=9242): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9242)] 01:34:58.596198 run osmo-msc_10.42.42.6(pid=9242): stdout: | (launched: 2022-12-10_01:34:57.422864) 01:34:58.647048 run osmo-msc_10.42.42.6(pid=9242): stderr: | 20221210013457745 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210013457746 DLGLOBAL DEBUG validating counter group 0x7ff48d21ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210013457746 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210013457746 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210013457746 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210013457746 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210013457748 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210013457748 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210013457748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210013457748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:34:58.698488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9235): Terminating (SIGTERM) 01:34:58.739544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9238): Terminating (SIGTERM) 01:34:58.780828 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9241): Terminating (SIGTERM) 01:34:58.823135 --- ParallelTerminationStrategy: PID 9235 died... 01:34:58.842991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9235): Terminated: ok {rc=0} 01:34:58.888609 --- ParallelTerminationStrategy: PID 9238 died... 01:34:58.908027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9238): Terminated: ok {rc=0} 01:34:58.953357 --- ParallelTerminationStrategy: PID 9241 died... 01:34:58.972272 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9241): Terminated: ok {rc=0} 01:34:59.058785 bus /sierra_3: Setting Powered False 01:35:00.156017 bus /sierra_3: Setting Powered False 01:35:01.273711 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:35:02.524855 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:35:02.531374 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:35:02.560370 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 01:35:02.586224 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:35:02.637805 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:35:02.666891 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 01:35:02.692369 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:35:03.242729 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 01:35:03.290376 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:03.301645 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:35:03.365870 tst mo_mt_call.py: using LAC 25073 01:35:03.481752 tst mo_mt_call.py: using RAC 83 01:35:03.596242 tst mo_mt_call.py: using CellId 25073 01:35:03.711164 tst mo_mt_call.py: using BVCI 25074 01:35:03.817179 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:03.828275 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:03.839197 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:03.850345 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:03.861630 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:03.872725 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:35:03.987955 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:35:04.103373 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:35:04.559594 run create_hlr_db(pid=9250): Launched 01:35:04.672670 bus /sierra_2: Setting Powered False 01:35:05.731767 run create_hlr_db(pid=9250): Terminated: ok {rc=0} 01:35:06.142152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9252): Launched 01:35:06.436121 run osmo-hlr_10.42.42.2(pid=9253): Launched 01:35:06.547979 run osmo-stp_10.42.42.5: Starting osmo-stp 01:35:07.066340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9255): Launched 01:35:07.359648 run osmo-stp_10.42.42.5(pid=9256): Launched 01:35:07.472372 run osmo-msc_10.42.42.6: Starting osmo-msc 01:35:08.005990 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9258): Launched 01:35:08.300247 run osmo-msc_10.42.42.6(pid=9259): Launched 01:35:08.465615 run osmo-stp_10.42.42.5(pid=9256): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9256)] 01:35:08.590512 run osmo-stp_10.42.42.5(pid=9256): stdout: | (launched: 2022-12-10_01:35:07.305907) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:35:08.715435 run osmo-stp_10.42.42.5(pid=9256): stderr: | 20221210013507473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013507473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013507473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013507474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013507474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013507474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013507474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:35:08.837780 run osmo-stp_10.42.42.5(pid=9256): stdout: | (launched: 2022-12-10_01:35:07.305907) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:35:08.954619 run osmo-stp_10.42.42.5(pid=9256): stderr: | 20221210013507473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013507473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013507473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013507474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013507474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013507474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013507474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:35:09.095233 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9256): Process ended prematurely: osmo-stp_10.42.42.5(pid=9256) [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9256)] [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 01:35:09.103996 tst mo_mt_call.py:8: Test FAILED (5.8 sec) 01:35:09.130761 run osmo-hlr_10.42.42.2(pid=9253): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9253)] 01:35:09.178153 run osmo-hlr_10.42.42.2(pid=9253): stdout: | (launched: 2022-12-10_01:35:06.382212) 01:35:09.226942 run osmo-hlr_10.42.42.2(pid=9253): stderr: | 20221210013506555 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013506555 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013506556 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013506556 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013506556 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013506556 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013506567 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013506576 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013506576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013506577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:35:09.295449 run osmo-msc_10.42.42.6(pid=9259): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9259)] 01:35:09.342359 run osmo-msc_10.42.42.6(pid=9259): stdout: | (launched: 2022-12-10_01:35:08.245852) 01:35:09.391032 run osmo-msc_10.42.42.6(pid=9259): stderr: | 20221210013508514 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210013508514 DLGLOBAL DEBUG validating counter group 0x7f11e4b75c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210013508514 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210013508514 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210013508514 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210013508515 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210013508517 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210013508517 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210013508517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210013508517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:35:09.439977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9252): Terminating (SIGTERM) 01:35:09.479244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9255): Terminating (SIGTERM) 01:35:09.518320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9258): Terminating (SIGTERM) 01:35:09.557929 --- ParallelTerminationStrategy: PID 9252 died... 01:35:09.576700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9252): Terminated: ok {rc=0} 01:35:09.620509 --- ParallelTerminationStrategy: PID 9255 died... 01:35:09.639019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9255): Terminated: ok {rc=0} 01:35:09.682630 --- ParallelTerminationStrategy: PID 9258 died... 01:35:09.700933 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9258): Terminated: ok {rc=0} 01:35:09.783939 bus /sierra_3: Setting Powered False 01:35:10.878506 bus /sierra_3: Setting Powered False 01:35:11.992529 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 01:35:13.135630 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:13.147263 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:35:13.212215 tst mo_mt_call_osmux.py: using LAC 25074 01:35:13.328869 tst mo_mt_call_osmux.py: using RAC 84 01:35:13.443975 tst mo_mt_call_osmux.py: using CellId 25074 01:35:13.561296 tst mo_mt_call_osmux.py: using BVCI 25075 01:35:13.668710 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:13.679994 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:13.691087 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:13.702438 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:13.714196 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:13.725450 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:35:13.843688 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:35:13.958863 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:35:14.416004 run create_hlr_db(pid=9261): Launched 01:35:14.528625 bus /sierra_2: Setting Powered False 01:35:15.588215 run create_hlr_db(pid=9261): Terminated: ok {rc=0} 01:35:16.019119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9263): Launched 01:35:16.347400 run osmo-hlr_10.42.42.2(pid=9264): Launched 01:35:16.516529 run osmo-stp_10.42.42.5: Starting osmo-stp 01:35:17.183944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9266): Launched 01:35:17.491691 run osmo-stp_10.42.42.5(pid=9267): Launched 01:35:17.605260 run osmo-msc_10.42.42.6: Starting osmo-msc 01:35:18.137474 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9269): Launched 01:35:18.434634 run osmo-msc_10.42.42.6(pid=9270): Launched 01:35:18.600504 run osmo-stp_10.42.42.5(pid=9267): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9267)] 01:35:18.725159 run osmo-stp_10.42.42.5(pid=9267): stdout: | (launched: 2022-12-10_01:35:17.437146) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:35:18.849589 run osmo-stp_10.42.42.5(pid=9267): stderr: | 20221210013517604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013517605 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013517605 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013517605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013517606 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013517606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013517606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:35:18.971684 run osmo-stp_10.42.42.5(pid=9267): stdout: | (launched: 2022-12-10_01:35:17.437146) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:35:19.088630 run osmo-stp_10.42.42.5(pid=9267): stderr: | 20221210013517604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013517605 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013517605 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013517605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013517606 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013517606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013517606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:35:19.228917 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9267): Process ended prematurely: osmo-stp_10.42.42.5(pid=9267) [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9267)] [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 01:35:19.237673 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 01:35:19.264371 run osmo-hlr_10.42.42.2(pid=9264): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9264)] 01:35:19.311851 run osmo-hlr_10.42.42.2(pid=9264): stdout: | (launched: 2022-12-10_01:35:16.278254) 01:35:19.360563 run osmo-hlr_10.42.42.2(pid=9264): stderr: | 20221210013516628 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013516628 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013516628 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013516628 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013516628 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013516628 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013516649 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013516658 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013516658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013516658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:35:19.429067 run osmo-msc_10.42.42.6(pid=9270): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9270)] 01:35:19.476176 run osmo-msc_10.42.42.6(pid=9270): stdout: | (launched: 2022-12-10_01:35:18.380310) 01:35:19.525130 run osmo-msc_10.42.42.6(pid=9270): stderr: | 20221210013518650 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210013518650 DLGLOBAL DEBUG validating counter group 0x7f29d3a2cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210013518650 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210013518650 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210013518650 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210013518651 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210013518652 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210013518653 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210013518653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210013518653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:35:19.574070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9263): Terminating (SIGTERM) 01:35:19.613384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9266): Terminating (SIGTERM) 01:35:19.653105 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9269): Terminating (SIGTERM) 01:35:19.692843 --- ParallelTerminationStrategy: PID 9263 died... 01:35:19.711434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9263): Terminated: ok {rc=0} 01:35:19.755416 --- ParallelTerminationStrategy: PID 9266 died... 01:35:19.774070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9266): Terminated: ok {rc=0} 01:35:19.817950 --- ParallelTerminationStrategy: PID 9269 died... 01:35:19.836368 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9269): Terminated: ok {rc=0} 01:35:19.919600 bus /sierra_3: Setting Powered False 01:35:21.016093 bus /sierra_3: Setting Powered False 01:35:22.131480 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 01:35:23.380724 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:35:23.386825 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 01:35:23.415744 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 01:35:23.442638 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 01:35:23.495322 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 01:35:23.524612 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 01:35:23.551093 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 01:35:24.101895 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 01:35:24.152317 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:35:24.163649 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:35:24.230334 tst mo_mt_call.py: using LAC 25075 01:35:24.353255 tst mo_mt_call.py: using RAC 85 01:35:24.477330 tst mo_mt_call.py: using CellId 25075 01:35:24.602038 tst mo_mt_call.py: using BVCI 25076 01:35:24.715995 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:35:24.727392 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:35:24.738557 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:35:24.749702 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:35:24.760926 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:35:24.772044 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:35:24.884062 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:35:24.996354 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:35:25.453677 run create_hlr_db(pid=9275): Launched 01:35:25.568493 bus /sierra_2: Setting Powered False 01:35:26.627404 run create_hlr_db(pid=9275): Terminated: ok {rc=0} 01:35:27.038168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9277): Launched 01:35:27.333276 run osmo-hlr_10.42.42.2(pid=9278): Launched 01:35:27.446417 run osmo-stp_10.42.42.5: Starting osmo-stp 01:35:27.962980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9280): Launched 01:35:28.257303 run osmo-stp_10.42.42.5(pid=9281): Launched 01:35:28.369851 run osmo-msc_10.42.42.6: Starting osmo-msc 01:35:28.901596 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9283): Launched 01:35:29.197458 run osmo-msc_10.42.42.6(pid=9284): Launched 01:35:29.364564 run osmo-stp_10.42.42.5(pid=9281): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9281)] 01:35:29.490550 run osmo-stp_10.42.42.5(pid=9281): stdout: | (launched: 2022-12-10_01:35:28.203068) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:35:29.616176 run osmo-stp_10.42.42.5(pid=9281): stderr: | 20221210013528370 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013528370 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013528371 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013528371 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013528372 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013528372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013528372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:35:29.739579 run osmo-stp_10.42.42.5(pid=9281): stdout: | (launched: 2022-12-10_01:35:28.203068) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:35:29.857295 run osmo-stp_10.42.42.5(pid=9281): stderr: | 20221210013528370 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013528370 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013528371 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013528371 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013528372 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013528372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013528372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:35:29.998357 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9281): Process ended prematurely: osmo-stp_10.42.42.5(pid=9281) [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9281)] [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 01:35:30.007100 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 01:35:30.033755 run osmo-hlr_10.42.42.2(pid=9278): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9278)] 01:35:30.080369 run osmo-hlr_10.42.42.2(pid=9278): stdout: | (launched: 2022-12-10_01:35:27.279322) 01:35:30.128806 run osmo-hlr_10.42.42.2(pid=9278): stderr: | 20221210013527453 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013527453 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013527453 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013527453 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013527453 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013527453 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013527464 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013527472 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013527473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013527473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:35:30.196787 run osmo-msc_10.42.42.6(pid=9284): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9284)] 01:35:30.244245 run osmo-msc_10.42.42.6(pid=9284): stdout: | (launched: 2022-12-10_01:35:29.142745) 01:35:30.293179 run osmo-msc_10.42.42.6(pid=9284): stderr: | 20221210013529411 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210013529411 DLGLOBAL DEBUG validating counter group 0x7fde339a2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210013529411 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210013529411 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210013529411 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210013529412 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210013529414 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210013529414 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210013529414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210013529415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:35:30.341986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9277): Terminating (SIGTERM) 01:35:30.381014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9280): Terminating (SIGTERM) 01:35:30.419886 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9283): Terminating (SIGTERM) 01:35:30.459359 --- ParallelTerminationStrategy: PID 9277 died... 01:35:30.478185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9277): Terminated: ok {rc=0} 01:35:30.521672 --- ParallelTerminationStrategy: PID 9280 died... 01:35:30.539916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9280): Terminated: ok {rc=0} 01:35:30.583857 --- ParallelTerminationStrategy: PID 9283 died... 01:35:30.602214 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9283): Terminated: ok {rc=0} 01:35:30.684767 bus /sierra_3: Setting Powered False 01:35:31.789434 bus /sierra_3: Setting Powered False 01:35:32.919288 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 01:35:34.062819 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:35:34.074396 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:35:34.138981 tst mo_mt_call_osmux.py: using LAC 25076 01:35:34.254636 tst mo_mt_call_osmux.py: using RAC 86 01:35:34.370012 tst mo_mt_call_osmux.py: using CellId 25076 01:35:34.492172 tst mo_mt_call_osmux.py: using BVCI 25077 01:35:34.599803 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:35:34.610852 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:35:34.621616 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:35:34.632474 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:35:34.643493 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:35:34.654421 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:35:34.772109 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:35:34.886450 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:35:35.342898 run create_hlr_db(pid=9286): Launched 01:35:35.455641 bus /sierra_2: Setting Powered False 01:35:36.515315 run create_hlr_db(pid=9286): Terminated: ok {rc=0} 01:35:36.925313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9288): Launched 01:35:37.219334 run osmo-hlr_10.42.42.2(pid=9289): Launched 01:35:37.331804 run osmo-stp_10.42.42.5: Starting osmo-stp 01:35:37.835582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9291): Launched 01:35:38.128459 run osmo-stp_10.42.42.5(pid=9292): Launched 01:35:38.241211 run osmo-msc_10.42.42.6: Starting osmo-msc 01:35:38.771828 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9294): Launched 01:35:39.066954 run osmo-msc_10.42.42.6(pid=9295): Launched 01:35:39.232222 run osmo-stp_10.42.42.5(pid=9292): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9292)] 01:35:39.356674 run osmo-stp_10.42.42.5(pid=9292): stdout: | (launched: 2022-12-10_01:35:38.074655) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:35:39.480874 run osmo-stp_10.42.42.5(pid=9292): stderr: | 20221210013538242 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013538242 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013538242 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013538243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013538243 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013538243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013538243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:35:39.602893 run osmo-stp_10.42.42.5(pid=9292): stdout: | (launched: 2022-12-10_01:35:38.074655) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:35:39.719516 run osmo-stp_10.42.42.5(pid=9292): stderr: | 20221210013538242 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013538242 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013538242 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013538243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013538243 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013538243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013538243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:35:39.859406 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9292): Process ended prematurely: osmo-stp_10.42.42.5(pid=9292) [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9292)] [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 01:35:39.868060 tst mo_mt_call_osmux.py:8: Test FAILED (5.8 sec) 01:35:39.894491 run osmo-hlr_10.42.42.2(pid=9289): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9289)] 01:35:39.941731 run osmo-hlr_10.42.42.2(pid=9289): stdout: | (launched: 2022-12-10_01:35:37.165351) 01:35:39.996084 run osmo-hlr_10.42.42.2(pid=9289): stderr: | 20221210013537340 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013537340 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013537340 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013537340 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013537341 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013537341 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013537353 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013537361 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013537361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013537361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:35:40.067877 run osmo-msc_10.42.42.6(pid=9295): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9295)] 01:35:40.118453 run osmo-msc_10.42.42.6(pid=9295): stdout: | (launched: 2022-12-10_01:35:39.012740) 01:35:40.169632 run osmo-msc_10.42.42.6(pid=9295): stderr: | 20221210013539281 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210013539282 DLGLOBAL DEBUG validating counter group 0x7f3146f77c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210013539282 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210013539282 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210013539282 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210013539282 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210013539284 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210013539284 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210013539284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210013539285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:35:40.221208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9288): Terminating (SIGTERM) 01:35:40.262184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9291): Terminating (SIGTERM) 01:35:40.303336 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9294): Terminating (SIGTERM) 01:35:40.345435 --- ParallelTerminationStrategy: PID 9288 died... 01:35:40.365458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9288): Terminated: ok {rc=0} 01:35:40.410944 --- ParallelTerminationStrategy: PID 9291 died... 01:35:40.430344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9291): Terminated: ok {rc=0} 01:35:40.475839 --- ParallelTerminationStrategy: PID 9294 died... 01:35:40.495244 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9294): Terminated: ok {rc=0} 01:35:40.580992 bus /sierra_3: Setting Powered False 01:35:41.676777 bus /sierra_3: Setting Powered False 01:35:42.790485 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 01:35:44.034716 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:35:44.039350 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 01:35:44.068522 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 01:35:44.095124 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 01:35:44.181219 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 01:35:44.210207 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 01:35:44.236752 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 01:35:44.823005 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2367 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 01:35:44.828113 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:35:44.839188 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 01:35:44.884083 tst emergency_mo_mt_call.py: using LAC 25077 01:35:45.007114 tst emergency_mo_mt_call.py: using RAC 87 01:35:45.128523 tst emergency_mo_mt_call.py: using CellId 25077 01:35:45.252611 tst emergency_mo_mt_call.py: using BVCI 25078 01:35:45.364890 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:35:45.376029 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:35:45.386990 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:35:45.397859 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:35:45.408597 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:35:45.419363 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:35:45.530549 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:35:45.645655 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:35:46.191171 run create_hlr_db(pid=9301): Launched 01:35:46.326379 bus /sierra_2: Setting Powered False 01:35:47.385809 run create_hlr_db(pid=9301): Terminated: ok {rc=0} 01:35:47.789439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9303): Launched 01:35:48.079785 run osmo-hlr_10.42.42.2(pid=9304): Launched 01:35:48.190238 run osmo-stp_10.42.42.5: Starting osmo-stp 01:35:48.699315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9306): Launched 01:35:48.987838 run osmo-stp_10.42.42.5(pid=9307): Launched 01:35:49.108336 tst emergency_mo_mt_call.py: using MSISDN 7479 01:35:49.255770 run osmo-msc_10.42.42.6: Starting osmo-msc 01:35:49.779463 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9309): Launched 01:35:50.069938 run osmo-msc_10.42.42.6(pid=9310): Launched 01:35:50.233136 run osmo-stp_10.42.42.5(pid=9307): ERR: Terminated: ERROR {rc=1} [trial-2367↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9307)] 01:35:50.355904 run osmo-stp_10.42.42.5(pid=9307): stdout: | (launched: 2022-12-10_01:35:48.934755) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:35:50.478905 run osmo-stp_10.42.42.5(pid=9307): stderr: | 20221210013549099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013549099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013549100 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013549100 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013549101 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013549101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013549101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:35:50.600100 run osmo-stp_10.42.42.5(pid=9307): stdout: | (launched: 2022-12-10_01:35:48.934755) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:35:50.715606 run osmo-stp_10.42.42.5(pid=9307): stderr: | 20221210013549099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013549099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013549100 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013549100 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013549101 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013549101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013549101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:35:50.854019 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=9307): Process ended prematurely: osmo-stp_10.42.42.5(pid=9307) [trial-2367↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9307)] [trial-2367↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 01:35:50.862180 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 01:35:50.888474 run osmo-hlr_10.42.42.2(pid=9304): ERR: Terminated: ERROR {rc=237} [trial-2367↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9304)] 01:35:50.936462 run osmo-hlr_10.42.42.2(pid=9304): stdout: | (launched: 2022-12-10_01:35:48.026729) 01:35:50.986002 run osmo-hlr_10.42.42.2(pid=9304): stderr: | 20221210013548200 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013548200 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013548200 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013548200 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013548200 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013548201 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013548213 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013548222 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013548222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013548222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:35:51.054342 run osmo-msc_10.42.42.6(pid=9310): ERR: Terminated: ERROR {rc=2} [trial-2367↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9310)] 01:35:51.101765 run osmo-msc_10.42.42.6(pid=9310): stdout: | (launched: 2022-12-10_01:35:50.016056) 01:35:51.150913 run osmo-msc_10.42.42.6(pid=9310): stderr: | 20221210013550284 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210013550284 DLGLOBAL DEBUG validating counter group 0x7f52125e1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210013550285 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210013550285 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210013550285 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210013550285 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210013550287 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210013550287 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210013550287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210013550287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:35:51.200526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9303): Terminating (SIGTERM) 01:35:51.239962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9306): Terminating (SIGTERM) 01:35:51.279296 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9309): Terminating (SIGTERM) 01:35:51.319006 --- ParallelTerminationStrategy: PID 9303 died... 01:35:51.338048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9303): Terminated: ok {rc=0} 01:35:51.382073 --- ParallelTerminationStrategy: PID 9306 died... 01:35:51.400514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9306): Terminated: ok {rc=0} 01:35:51.444114 --- ParallelTerminationStrategy: PID 9309 died... 01:35:51.462699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9309): Terminated: ok {rc=0} 01:35:51.547801 bus /sierra_3: Setting Powered False 01:35:52.646559 bus /sierra_3: Setting Powered False 01:35:53.760441 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 01:35:54.848142 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:35:54.860016 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 01:35:54.908090 tst emergency_preemptive_call.py: using LAC 25078 01:35:55.031844 tst emergency_preemptive_call.py: using RAC 88 01:35:55.153631 tst emergency_preemptive_call.py: using CellId 25078 01:35:55.278106 tst emergency_preemptive_call.py: using BVCI 25079 01:35:55.385778 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:35:55.396565 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:35:55.407291 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:35:55.418850 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:35:55.430382 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:35:55.441841 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:35:55.559109 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:35:55.671088 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:35:55.788454 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:35:55.900732 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:35:56.351197 run create_hlr_db(pid=9312): Launched 01:35:56.462793 bus /sierra_2: Setting Powered False 01:35:57.520416 run create_hlr_db(pid=9312): Terminated: ok {rc=0} 01:35:57.943965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9314): Launched 01:35:58.255190 run osmo-hlr_10.42.42.2(pid=9315): Launched 01:35:58.373949 run osmo-stp_10.42.42.5: Starting osmo-stp 01:35:58.908629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9317): Launched 01:35:59.220312 run osmo-stp_10.42.42.5(pid=9318): Launched 01:35:59.348396 tst emergency_preemptive_call.py: using MSISDN 7480 01:35:59.508062 run osmo-msc_10.42.42.6: Starting osmo-msc 01:36:00.065768 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9320): Launched 01:36:00.377663 run osmo-msc_10.42.42.6(pid=9321): Launched 01:36:00.551467 run osmo-stp_10.42.42.5(pid=9318): ERR: Terminated: ERROR {rc=1} [trial-2367↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9318)] 01:36:00.681897 run osmo-stp_10.42.42.5(pid=9318): stdout: | (launched: 2022-12-10_01:35:59.163544) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:36:00.812646 run osmo-stp_10.42.42.5(pid=9318): stderr: | 20221210013559351 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013559352 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013559352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013559352 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013559353 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013559353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013559353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:36:00.998803 run osmo-stp_10.42.42.5(pid=9318): stdout: | (launched: 2022-12-10_01:35:59.163544) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:36:01.119506 run osmo-stp_10.42.42.5(pid=9318): stderr: | 20221210013559351 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013559352 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013559352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013559352 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013559353 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013559353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013559353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:36:01.262074 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=9318): Process ended prematurely: osmo-stp_10.42.42.5(pid=9318) [trial-2367↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9318)] [trial-2367↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 01:36:01.271516 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 01:36:01.301322 run osmo-hlr_10.42.42.2(pid=9315): ERR: Terminated: ERROR {rc=237} [trial-2367↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9315)] 01:36:01.353720 run osmo-hlr_10.42.42.2(pid=9315): stdout: | (launched: 2022-12-10_01:35:58.198283) 01:36:01.406503 run osmo-hlr_10.42.42.2(pid=9315): stderr: | 20221210013558392 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013558392 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013558392 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013558392 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013558392 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013558393 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013558405 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013558413 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013558414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013558414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:36:01.478764 run osmo-msc_10.42.42.6(pid=9321): ERR: Terminated: ERROR {rc=2} [trial-2367↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9321)] 01:36:01.530429 run osmo-msc_10.42.42.6(pid=9321): stdout: | (launched: 2022-12-10_01:36:00.320596) 01:36:01.582463 run osmo-msc_10.42.42.6(pid=9321): stderr: | 20221210013600641 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210013600641 DLGLOBAL DEBUG validating counter group 0x7fd559a6fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210013600641 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210013600641 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210013600642 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210013600642 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210013600644 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210013600644 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210013600644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210013600644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:36:01.635774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9314): Terminating (SIGTERM) 01:36:01.679171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9317): Terminating (SIGTERM) 01:36:01.724640 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9320): Terminating (SIGTERM) 01:36:01.769215 --- ParallelTerminationStrategy: PID 9314 died... 01:36:01.789248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9314): Terminated: ok {rc=0} 01:36:01.837997 --- ParallelTerminationStrategy: PID 9317 died... 01:36:01.858032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9317): Terminated: ok {rc=0} 01:36:01.906201 --- ParallelTerminationStrategy: PID 9320 died... 01:36:01.927198 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9320): Terminated: ok {rc=0} 01:36:02.018836 bus /sierra_9: Setting Powered False 01:36:03.128261 bus /sierra_9: Setting Powered False 01:36:04.244274 bus /sierra_8: Setting Powered False 01:36:05.341068 bus /sierra_8: Setting Powered False 01:36:06.455232 bus /sierra_3: Setting Powered False 01:36:07.551519 bus /sierra_3: Setting Powered False 01:36:08.666940 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 01:36:09.933802 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:36:09.938228 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 01:36:09.967202 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 01:36:10.004919 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 01:36:10.089651 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 01:36:10.118497 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 01:36:10.155882 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 01:36:10.743910 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 01:36:10.792697 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:10.803316 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 01:36:10.847262 tst cs_paging_gprs_active.py: using LAC 25079 01:36:10.967856 tst cs_paging_gprs_active.py: using RAC 89 01:36:11.083555 tst cs_paging_gprs_active.py: using CellId 25079 01:36:11.207733 tst cs_paging_gprs_active.py: using BVCI 25080 01:36:11.322591 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:11.333765 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:11.344799 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:11.355573 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:11.366542 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:11.377318 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:11.388186 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:11.399428 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:11.410571 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:36:11.526519 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:36:11.644219 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:36:11.858286 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:36:12.176585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9327): Launched 01:36:12.452222 run iperf3-srv_10.42.42.10(pid=9328): Launched 01:36:12.571423 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:36:12.785548 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:36:13.103147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9329): Launched 01:36:13.379853 run iperf3-srv_10.42.42.10(pid=9330): Launched 01:36:13.498947 tst cs_paging_gprs_active.py:38: start network... 01:36:13.711595 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:36:14.203070 run create_hlr_db(pid=9331): Launched 01:36:14.332738 bus /sierra_2: Setting Powered False 01:36:15.395979 run create_hlr_db(pid=9331): Terminated: ok {rc=0} 01:36:15.816789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9333): Launched 01:36:16.153699 run osmo-hlr_10.42.42.2(pid=9334): Launched 01:36:16.388578 run osmo-stp_10.42.42.5: Starting osmo-stp 01:36:17.026566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9336): Launched 01:36:17.355509 run osmo-stp_10.42.42.5(pid=9337): Launched 01:36:17.476316 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:36:18.023771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9339): Launched 01:36:18.145861 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:36:18.413451 run patchelf(pid=9340): Launched 01:36:18.590788 run osmo-stp_10.42.42.5(pid=9337): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9337)] 01:36:18.725424 run osmo-stp_10.42.42.5(pid=9337): stdout: | (launched: 2022-12-10_01:36:17.297485) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:36:18.861460 run osmo-stp_10.42.42.5(pid=9337): stderr: | 20221210013617484 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013617484 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013617484 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013617485 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013617485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013617485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013617485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:36:18.997654 run osmo-stp_10.42.42.5(pid=9337): stdout: | (launched: 2022-12-10_01:36:17.297485) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:36:19.128282 run osmo-stp_10.42.42.5(pid=9337): stderr: | 20221210013617484 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013617484 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013617484 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013617485 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013617485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013617485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013617485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:36:19.282926 run patchelf(pid=9340): Terminating (SIGINT) 01:36:19.460367 run patchelf(pid=9340): Terminated: ok {rc=0} 01:36:19.588492 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9337): Process ended prematurely: osmo-stp_10.42.42.5(pid=9337) [trial-2367↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9337)] [trial-2367↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 01:36:19.598373 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 01:36:19.626443 run osmo-hlr_10.42.42.2(pid=9334): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9334)] 01:36:19.675403 run osmo-hlr_10.42.42.2(pid=9334): stdout: | (launched: 2022-12-10_01:36:16.085435) 01:36:19.726161 run osmo-hlr_10.42.42.2(pid=9334): stderr: | 20221210013616392 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013616392 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013616392 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013616392 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013616393 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013616393 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013616407 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013616417 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013616417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013616417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:36:19.777261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9327): Terminating (SIGTERM) 01:36:19.818458 run iperf3-srv_10.42.42.10(pid=9328): Terminating (SIGTERM) 01:36:19.859563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9329): Terminating (SIGTERM) 01:36:19.900650 run iperf3-srv_10.42.42.10(pid=9330): Terminating (SIGTERM) 01:36:19.941909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9333): Terminating (SIGTERM) 01:36:19.983035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9336): Terminating (SIGTERM) 01:36:20.024254 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9339): Terminating (SIGTERM) 01:36:20.065919 --- ParallelTerminationStrategy: PID 9327 died... 01:36:20.085755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9327): Terminated: ok {rc=0} 01:36:20.132213 --- ParallelTerminationStrategy: PID 9328 died... 01:36:20.151592 run iperf3-srv_10.42.42.10(pid=9328): Terminated {rc=256} 01:36:20.196724 --- ParallelTerminationStrategy: PID 9329 died... 01:36:20.215993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9329): Terminated: ok {rc=0} 01:36:20.261313 --- ParallelTerminationStrategy: PID 9330 died... 01:36:20.280386 run iperf3-srv_10.42.42.10(pid=9330): Terminated {rc=256} 01:36:20.325805 --- ParallelTerminationStrategy: PID 9333 died... 01:36:20.345176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9333): Terminated: ok {rc=0} 01:36:20.390447 --- ParallelTerminationStrategy: PID 9336 died... 01:36:20.409803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9336): Terminated: ok {rc=0} 01:36:20.455010 --- ParallelTerminationStrategy: PID 9339 died... 01:36:20.474474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9339): Terminated: ok {rc=0} 01:36:20.560754 bus /gobi_0: Setting Powered False 01:36:21.659288 bus /gobi_0: Setting Powered False 01:36:22.773924 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 01:36:23.920679 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:23.932775 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 01:36:23.984350 tst iperf3.py: using LAC 25080 01:36:24.107653 tst iperf3.py: using RAC 90 01:36:24.224673 tst iperf3.py: using CellId 25080 01:36:24.338820 tst iperf3.py: using BVCI 25081 01:36:24.445737 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:24.456536 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:24.467108 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:24.478326 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:24.489724 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:24.500674 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:24.512003 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:24.522937 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:24.534316 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:36:24.653780 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:36:24.867635 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:36:25.184652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9341): Launched 01:36:25.459803 run iperf3-srv_10.42.42.10(pid=9342): Launched 01:36:25.578973 tst iperf3.py:8: start network... 01:36:25.791739 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:36:26.280763 run create_hlr_db(pid=9343): Launched 01:36:26.409962 bus /gobi_6: Setting Powered False 01:36:27.472568 run create_hlr_db(pid=9343): Terminated: ok {rc=0} 01:36:27.892312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9345): Launched 01:36:28.187415 run osmo-hlr_10.42.42.2(pid=9346): Launched 01:36:28.300745 run osmo-stp_10.42.42.5: Starting osmo-stp 01:36:28.825517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9348): Launched 01:36:29.123857 run osmo-stp_10.42.42.5(pid=9349): Launched 01:36:29.236598 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:36:29.743624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9351): Launched 01:36:29.857918 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:36:30.106335 run patchelf(pid=9352): Launched 01:36:30.270657 run osmo-stp_10.42.42.5(pid=9349): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9349)] 01:36:30.395138 run osmo-stp_10.42.42.5(pid=9349): stdout: | (launched: 2022-12-10_01:36:29.068147) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:36:30.520788 run osmo-stp_10.42.42.5(pid=9349): stderr: | 20221210013629237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013629237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013629238 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013629238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013629238 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013629239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013629239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:36:30.646686 run osmo-stp_10.42.42.5(pid=9349): stdout: | (launched: 2022-12-10_01:36:29.068147) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:36:30.767903 run osmo-stp_10.42.42.5(pid=9349): stderr: | 20221210013629237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013629237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013629238 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013629238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013629238 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013629239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013629239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:36:30.937456 run patchelf(pid=9352): Terminating (SIGINT) 01:36:31.121263 run patchelf(pid=9352): Terminated: ok {rc=0} 01:36:31.252939 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9349): Process ended prematurely: osmo-stp_10.42.42.5(pid=9349) [trial-2367↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9349)] [trial-2367↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 01:36:31.263522 tst iperf3.py:8: Test FAILED (7.4 sec) 01:36:31.293487 run osmo-hlr_10.42.42.2(pid=9346): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9346)] 01:36:31.345446 run osmo-hlr_10.42.42.2(pid=9346): stdout: | (launched: 2022-12-10_01:36:28.133648) 01:36:31.399215 run osmo-hlr_10.42.42.2(pid=9346): stderr: | 20221210013628307 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013628307 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013628307 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013628307 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013628307 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013628308 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013628321 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013628329 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013628329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013628329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:36:31.452709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9341): Terminating (SIGTERM) 01:36:31.495816 run iperf3-srv_10.42.42.10(pid=9342): Terminating (SIGTERM) 01:36:31.543062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9345): Terminating (SIGTERM) 01:36:31.586802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9348): Terminating (SIGTERM) 01:36:31.631183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9351): Terminating (SIGTERM) 01:36:31.677041 --- ParallelTerminationStrategy: PID 9341 died... 01:36:31.697844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9341): Terminated: ok {rc=0} 01:36:31.749017 --- ParallelTerminationStrategy: PID 9342 died... 01:36:31.769350 run iperf3-srv_10.42.42.10(pid=9342): Terminated {rc=256} 01:36:31.817641 --- ParallelTerminationStrategy: PID 9345 died... 01:36:31.837733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9345): Terminated: ok {rc=0} 01:36:31.885948 --- ParallelTerminationStrategy: PID 9348 died... 01:36:31.906133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9348): Terminated: ok {rc=0} 01:36:31.954971 --- ParallelTerminationStrategy: PID 9351 died... 01:36:31.975509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9351): Terminated: ok {rc=0} 01:36:32.065323 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 01:36:33.210361 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:33.221782 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 01:36:33.268190 tst iperf3m4.py: using LAC 25081 01:36:33.393643 tst iperf3m4.py: using RAC 91 01:36:33.509611 tst iperf3m4.py: using CellId 25081 01:36:33.634602 tst iperf3m4.py: using BVCI 25082 01:36:33.749642 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:33.760749 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:33.771769 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:33.782709 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:33.793709 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:33.804482 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:33.815600 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:33.826389 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:33.837385 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:36:33.950154 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:36:34.070386 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:36:34.184936 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:36:34.304715 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:36:34.502181 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:36:34.798242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9353): Launched 01:36:35.055417 run iperf3-srv_10.42.42.10(pid=9354): Launched 01:36:35.167558 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:36:35.364536 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:36:35.659920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9355): Launched 01:36:35.917067 run iperf3-srv_10.42.42.10(pid=9356): Launched 01:36:36.028350 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:36:36.224844 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:36:36.519982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9357): Launched 01:36:36.778011 run iperf3-srv_10.42.42.10(pid=9358): Launched 01:36:36.890265 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:36:37.087842 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:36:37.386177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9359): Launched 01:36:37.643049 run iperf3-srv_10.42.42.10(pid=9360): Launched 01:36:37.754520 tst iperf3m4.py:8: start network... 01:36:37.951957 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:36:38.407574 run create_hlr_db(pid=9361): Launched 01:36:38.521554 bus /gobi_6: Setting Powered False 01:36:39.580808 run create_hlr_db(pid=9361): Terminated: ok {rc=0} 01:36:39.991500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9363): Launched 01:36:40.287524 run osmo-hlr_10.42.42.2(pid=9364): Launched 01:36:40.400552 run osmo-stp_10.42.42.5: Starting osmo-stp 01:36:41.024074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9366): Launched 01:36:41.315903 run osmo-stp_10.42.42.5(pid=9367): Launched 01:36:41.427305 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:36:41.929404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9369): Launched 01:36:42.042048 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:36:42.288762 run patchelf(pid=9370): Launched 01:36:42.452416 run osmo-stp_10.42.42.5(pid=9367): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9367)] 01:36:42.576558 run osmo-stp_10.42.42.5(pid=9367): stdout: | (launched: 2022-12-10_01:36:41.262728) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:36:42.702360 run osmo-stp_10.42.42.5(pid=9367): stderr: | 20221210013641427 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013641428 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013641428 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013641428 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013641429 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013641429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013641429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:36:42.828550 run osmo-stp_10.42.42.5(pid=9367): stdout: | (launched: 2022-12-10_01:36:41.262728) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:36:42.949271 run osmo-stp_10.42.42.5(pid=9367): stderr: | 20221210013641427 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013641428 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013641428 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013641428 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013641429 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013641429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013641429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:36:43.092277 run patchelf(pid=9370): Terminating (SIGINT) 01:36:43.257309 run patchelf(pid=9370): Terminated: ok {rc=0} 01:36:43.376054 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9367): Process ended prematurely: osmo-stp_10.42.42.5(pid=9367) [trial-2367↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9367)] [trial-2367↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 01:36:43.385607 tst iperf3m4.py:8: Test FAILED (10.2 sec) 01:36:43.413426 run osmo-hlr_10.42.42.2(pid=9364): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9364)] 01:36:43.461098 run osmo-hlr_10.42.42.2(pid=9364): stdout: | (launched: 2022-12-10_01:36:40.233374) 01:36:43.510100 run osmo-hlr_10.42.42.2(pid=9364): stderr: | 20221210013640404 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013640404 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013640404 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013640404 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013640405 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013640405 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013640417 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013640425 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013640425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013640425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:36:43.559587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9353): Terminating (SIGTERM) 01:36:43.599172 run iperf3-srv_10.42.42.10(pid=9354): Terminating (SIGTERM) 01:36:43.638629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9355): Terminating (SIGTERM) 01:36:43.678267 run iperf3-srv_10.42.42.10(pid=9356): Terminating (SIGTERM) 01:36:43.717393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9357): Terminating (SIGTERM) 01:36:43.756629 run iperf3-srv_10.42.42.10(pid=9358): Terminating (SIGTERM) 01:36:43.795665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9359): Terminating (SIGTERM) 01:36:43.834872 run iperf3-srv_10.42.42.10(pid=9360): Terminating (SIGTERM) 01:36:43.873982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9363): Terminating (SIGTERM) 01:36:43.913110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9366): Terminating (SIGTERM) 01:36:43.952862 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9369): Terminating (SIGTERM) 01:36:43.992756 --- ParallelTerminationStrategy: PID 9353 died... 01:36:44.011762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9353): Terminated: ok {rc=0} 01:36:44.055951 --- ParallelTerminationStrategy: PID 9354 died... 01:36:44.074436 run iperf3-srv_10.42.42.10(pid=9354): Terminated {rc=256} 01:36:44.118179 --- ParallelTerminationStrategy: PID 9355 died... 01:36:44.136704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9355): Terminated: ok {rc=0} 01:36:44.181323 --- ParallelTerminationStrategy: PID 9356 died... 01:36:44.199605 run iperf3-srv_10.42.42.10(pid=9356): Terminated {rc=256} 01:36:44.243084 --- ParallelTerminationStrategy: PID 9357 died... 01:36:44.261477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9357): Terminated: ok {rc=0} 01:36:44.304941 --- ParallelTerminationStrategy: PID 9358 died... 01:36:44.323345 run iperf3-srv_10.42.42.10(pid=9358): Terminated {rc=256} 01:36:44.366983 --- ParallelTerminationStrategy: PID 9359 died... 01:36:44.385465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9359): Terminated: ok {rc=0} 01:36:44.429072 --- ParallelTerminationStrategy: PID 9360 died... 01:36:44.447388 run iperf3-srv_10.42.42.10(pid=9360): Terminated {rc=256} 01:36:44.490994 --- ParallelTerminationStrategy: PID 9363 died... 01:36:44.509576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9363): Terminated: ok {rc=0} 01:36:44.553232 --- ParallelTerminationStrategy: PID 9366 died... 01:36:44.571513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9366): Terminated: ok {rc=0} 01:36:44.615133 --- ParallelTerminationStrategy: PID 9369 died... 01:36:44.633443 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9369): Terminated: ok {rc=0} 01:36:44.716336 bus /gobi_4: Setting Powered False 01:36:45.813084 bus /gobi_4: Setting Powered False 01:36:46.949250 bus /gobi_1: Setting Powered False 01:36:48.056789 bus /gobi_1: Setting Powered False 01:36:49.170525 bus /gobi_0: Setting Powered False 01:36:50.267525 bus /gobi_0: Setting Powered False 01:36:51.379936 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 01:36:52.478289 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:52.489564 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 01:36:52.534565 tst ping.py: using LAC 25082 01:36:52.648842 tst ping.py: using RAC 92 01:36:52.761634 tst ping.py: using CellId 25082 01:36:52.874785 tst ping.py: using BVCI 25083 01:36:52.980311 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:52.990954 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:53.001436 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:53.012027 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:53.022663 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:53.033251 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:53.044002 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:53.054628 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:36:53.167164 tst ping.py:19: start network... 01:36:53.359012 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:36:53.805470 run create_hlr_db(pid=9372): Launched 01:36:53.916314 bus /gobi_6: Setting Powered False 01:36:54.974762 run create_hlr_db(pid=9372): Terminated: ok {rc=0} 01:36:55.398661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9374): Launched 01:36:55.709229 run osmo-hlr_10.42.42.2(pid=9375): Launched 01:36:55.827868 run osmo-stp_10.42.42.5: Starting osmo-stp 01:36:56.366601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9377): Launched 01:36:56.676008 run osmo-stp_10.42.42.5(pid=9378): Launched 01:36:56.794103 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:36:57.328452 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9380): Launched 01:36:57.446572 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:36:57.705963 run patchelf(pid=9381): Launched 01:36:57.877495 run osmo-stp_10.42.42.5(pid=9378): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9378)] 01:36:58.007337 run osmo-stp_10.42.42.5(pid=9378): stdout: | (launched: 2022-12-10_01:36:56.619501) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:36:58.139623 run osmo-stp_10.42.42.5(pid=9378): stderr: | 20221210013656809 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013656809 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013656810 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013656810 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013656810 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013656811 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013656811 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:36:58.271583 run osmo-stp_10.42.42.5(pid=9378): stdout: | (launched: 2022-12-10_01:36:56.619501) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:36:58.398595 run osmo-stp_10.42.42.5(pid=9378): stderr: | 20221210013656809 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013656809 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013656810 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013656810 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013656810 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013656811 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013656811 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:36:58.548484 run patchelf(pid=9381): Terminating (SIGINT) 01:36:58.720446 run patchelf(pid=9381): Terminated: ok {rc=0} 01:36:58.844160 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9378): Process ended prematurely: osmo-stp_10.42.42.5(pid=9378) [trial-2367↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9378)] [trial-2367↪gprs:trx-lms-limenet-micro↪ping.py:22] 01:36:58.853659 tst ping.py:22: Test FAILED (6.4 sec) 01:36:58.881366 run osmo-hlr_10.42.42.2(pid=9375): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9375)] 01:36:58.930483 run osmo-hlr_10.42.42.2(pid=9375): stdout: | (launched: 2022-12-10_01:36:55.652416) 01:36:58.982055 run osmo-hlr_10.42.42.2(pid=9375): stderr: | 20221210013655847 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013655847 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013655847 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013655847 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013655847 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013655847 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013655860 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013655870 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013655870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013655871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:36:59.033808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9374): Terminating (SIGTERM) 01:36:59.075170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9377): Terminating (SIGTERM) 01:36:59.116670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9380): Terminating (SIGTERM) 01:36:59.158665 --- ParallelTerminationStrategy: PID 9374 died... 01:36:59.178411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9374): Terminated: ok {rc=0} 01:36:59.224366 --- ParallelTerminationStrategy: PID 9377 died... 01:36:59.243751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9377): Terminated: ok {rc=0} 01:36:59.289328 --- ParallelTerminationStrategy: PID 9380 died... 01:36:59.308683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9380): Terminated: ok {rc=0} 01:36:59.394869 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 01:37:00.481879 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:00.493724 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 01:37:00.541456 tst ping_idle_ping.py: using LAC 25083 01:37:00.664161 tst ping_idle_ping.py: using RAC 93 01:37:00.787887 tst ping_idle_ping.py: using CellId 25083 01:37:00.920154 tst ping_idle_ping.py: using BVCI 25084 01:37:01.034807 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:01.046476 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:01.057946 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:01.070473 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:01.083982 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:01.096345 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:01.108190 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:01.120581 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:37:01.263071 tst ping_idle_ping.py:24: start network... 01:37:01.496870 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:37:02.055285 run create_hlr_db(pid=9382): Launched 01:37:02.224176 bus /gobi_6: Setting Powered False 01:37:03.286086 run create_hlr_db(pid=9382): Terminated: ok {rc=0} 01:37:03.700804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9384): Launched 01:37:03.992459 run osmo-hlr_10.42.42.2(pid=9385): Launched 01:37:04.104026 run osmo-stp_10.42.42.5: Starting osmo-stp 01:37:04.606516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9387): Launched 01:37:04.896785 run osmo-stp_10.42.42.5(pid=9388): Launched 01:37:05.007799 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:37:05.507228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9390): Launched 01:37:05.619133 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:37:05.863606 run patchelf(pid=9391): Launched 01:37:06.025688 run osmo-stp_10.42.42.5(pid=9388): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9388)] 01:37:06.148820 run osmo-stp_10.42.42.5(pid=9388): stdout: | (launched: 2022-12-10_01:37:04.843015) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:37:06.273464 run osmo-stp_10.42.42.5(pid=9388): stderr: | 20221210013705012 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013705012 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013705012 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013705012 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013705013 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013705013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013705013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:37:06.398800 run osmo-stp_10.42.42.5(pid=9388): stdout: | (launched: 2022-12-10_01:37:04.843015) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:37:06.518563 run osmo-stp_10.42.42.5(pid=9388): stderr: | 20221210013705012 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013705012 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013705012 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013705012 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013705013 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013705013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013705013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:37:06.660191 run patchelf(pid=9391): Terminating (SIGINT) 01:37:06.822652 run patchelf(pid=9391): Terminated: ok {rc=0} 01:37:06.940164 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9388): Process ended prematurely: osmo-stp_10.42.42.5(pid=9388) [trial-2367↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9388)] [trial-2367↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 01:37:06.949282 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 01:37:06.975828 run osmo-hlr_10.42.42.2(pid=9385): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9385)] 01:37:07.023181 run osmo-hlr_10.42.42.2(pid=9385): stdout: | (launched: 2022-12-10_01:37:03.938520) 01:37:07.071731 run osmo-hlr_10.42.42.2(pid=9385): stderr: | 20221210013704112 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013704112 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013704112 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013704112 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013704112 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013704112 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013704126 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013704135 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013704135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013704135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:37:07.120755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9384): Terminating (SIGTERM) 01:37:07.159704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9387): Terminating (SIGTERM) 01:37:07.198803 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9390): Terminating (SIGTERM) 01:37:07.237847 --- ParallelTerminationStrategy: PID 9384 died... 01:37:07.256015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9384): Terminated: ok {rc=0} 01:37:07.299178 --- ParallelTerminationStrategy: PID 9387 died... 01:37:07.317227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9387): Terminated: ok {rc=0} 01:37:07.360307 --- ParallelTerminationStrategy: PID 9390 died... 01:37:07.378619 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9390): Terminated: ok {rc=0} 01:37:07.463165 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 01:37:08.755931 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:37:08.762598 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 01:37:08.793586 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 01:37:08.832867 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 01:37:08.920129 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 01:37:08.951085 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 01:37:08.988611 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 01:37:09.588190 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 01:37:09.640748 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:09.652128 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:37:09.700511 tst cs_paging_gprs_active.py: using LAC 25084 01:37:09.826255 tst cs_paging_gprs_active.py: using RAC 94 01:37:09.950857 tst cs_paging_gprs_active.py: using CellId 25084 01:37:10.078483 tst cs_paging_gprs_active.py: using BVCI 25085 01:37:10.195592 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:10.207104 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:10.218327 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:10.229970 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:10.241531 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:10.253213 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:10.265141 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:10.277470 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:10.289371 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:37:10.404165 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:37:10.522175 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:37:10.735821 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:37:11.052876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9395): Launched 01:37:11.329386 run iperf3-srv_10.42.42.10(pid=9396): Launched 01:37:11.448327 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:37:11.660812 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:37:11.978269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9397): Launched 01:37:12.253096 run iperf3-srv_10.42.42.10(pid=9398): Launched 01:37:12.371184 tst cs_paging_gprs_active.py:38: start network... 01:37:12.582465 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:37:13.071295 run create_hlr_db(pid=9399): Launched 01:37:13.200669 bus /gobi_6: Setting Powered False 01:37:14.263224 run create_hlr_db(pid=9399): Terminated: ok {rc=0} 01:37:14.701026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9401): Launched 01:37:15.016327 run osmo-hlr_10.42.42.2(pid=9402): Launched 01:37:15.137930 run osmo-stp_10.42.42.5: Starting osmo-stp 01:37:15.680197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9404): Launched 01:37:16.010698 run osmo-stp_10.42.42.5(pid=9405): Launched 01:37:16.251484 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:37:16.861654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9407): Launched 01:37:16.993329 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:37:17.267917 run patchelf(pid=9408): Launched 01:37:17.443859 run osmo-stp_10.42.42.5(pid=9405): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9405)] 01:37:17.577453 run osmo-stp_10.42.42.5(pid=9405): stdout: | (launched: 2022-12-10_01:37:15.948379) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:37:17.712170 run osmo-stp_10.42.42.5(pid=9405): stderr: | 20221210013716240 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013716240 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013716240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013716245 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013716246 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013716246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013716246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:37:17.846919 run osmo-stp_10.42.42.5(pid=9405): stdout: | (launched: 2022-12-10_01:37:15.948379) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:37:17.976232 run osmo-stp_10.42.42.5(pid=9405): stderr: | 20221210013716240 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013716240 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013716240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013716245 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013716246 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013716246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013716246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:37:18.129655 run patchelf(pid=9408): Terminating (SIGINT) 01:37:18.305802 run patchelf(pid=9408): Terminated: ok {rc=0} 01:37:18.432428 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9405): Process ended prematurely: osmo-stp_10.42.42.5(pid=9405) [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9405)] [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 01:37:18.442419 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 01:37:18.470463 run osmo-hlr_10.42.42.2(pid=9402): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9402)] 01:37:18.519736 run osmo-hlr_10.42.42.2(pid=9402): stdout: | (launched: 2022-12-10_01:37:14.958481) 01:37:18.570693 run osmo-hlr_10.42.42.2(pid=9402): stderr: | 20221210013715156 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013715156 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013715156 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013715156 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013715156 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013715156 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013715173 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013715183 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013715183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013715183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:37:18.622036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9395): Terminating (SIGTERM) 01:37:18.663335 run iperf3-srv_10.42.42.10(pid=9396): Terminating (SIGTERM) 01:37:18.704591 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9397): Terminating (SIGTERM) 01:37:18.745995 run iperf3-srv_10.42.42.10(pid=9398): Terminating (SIGTERM) 01:37:18.787159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9401): Terminating (SIGTERM) 01:37:18.828599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9404): Terminating (SIGTERM) 01:37:18.869917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9407): Terminating (SIGTERM) 01:37:18.911446 --- ParallelTerminationStrategy: PID 9395 died... 01:37:18.931245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9395): Terminated: ok {rc=0} 01:37:18.977006 --- ParallelTerminationStrategy: PID 9396 died... 01:37:18.996226 run iperf3-srv_10.42.42.10(pid=9396): Terminated {rc=256} 01:37:19.041407 --- ParallelTerminationStrategy: PID 9397 died... 01:37:19.060719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9397): Terminated: ok {rc=0} 01:37:19.106014 --- ParallelTerminationStrategy: PID 9398 died... 01:37:19.125474 run iperf3-srv_10.42.42.10(pid=9398): Terminated {rc=256} 01:37:19.172539 --- ParallelTerminationStrategy: PID 9401 died... 01:37:19.191955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9401): Terminated: ok {rc=0} 01:37:19.237528 --- ParallelTerminationStrategy: PID 9404 died... 01:37:19.256879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9404): Terminated: ok {rc=0} 01:37:19.302488 --- ParallelTerminationStrategy: PID 9407 died... 01:37:19.321974 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9407): Terminated: ok {rc=0} 01:37:19.408223 bus /gobi_0: Setting Powered False 01:37:20.507183 bus /gobi_0: Setting Powered False 01:37:21.625850 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 01:37:22.772170 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:22.784226 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:37:22.832246 tst iperf3.py: using LAC 25085 01:37:22.961274 tst iperf3.py: using RAC 95 01:37:23.084721 tst iperf3.py: using CellId 25085 01:37:23.217079 tst iperf3.py: using BVCI 25086 01:37:23.333293 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:23.344796 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:23.355984 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:23.367291 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:23.378436 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:23.389649 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:23.400827 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:23.411960 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:23.423236 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:37:23.540209 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:37:23.736861 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:37:24.032814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9409): Launched 01:37:24.290932 run iperf3-srv_10.42.42.10(pid=9410): Launched 01:37:24.402438 tst iperf3.py:8: start network... 01:37:24.598982 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:37:25.054653 run create_hlr_db(pid=9411): Launched 01:37:25.170223 bus /gobi_6: Setting Powered False 01:37:26.229536 run create_hlr_db(pid=9411): Terminated: ok {rc=0} 01:37:26.640880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9413): Launched 01:37:26.937271 run osmo-hlr_10.42.42.2(pid=9414): Launched 01:37:27.050978 run osmo-stp_10.42.42.5: Starting osmo-stp 01:37:27.557408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9416): Launched 01:37:27.853818 run osmo-stp_10.42.42.5(pid=9417): Launched 01:37:27.968338 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:37:28.479128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9419): Launched 01:37:28.591458 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:37:28.840168 run patchelf(pid=9420): Launched 01:37:29.004548 run osmo-stp_10.42.42.5(pid=9417): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9417)] 01:37:29.129424 run osmo-stp_10.42.42.5(pid=9417): stdout: | (launched: 2022-12-10_01:37:27.799081) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:37:29.255948 run osmo-stp_10.42.42.5(pid=9417): stderr: | 20221210013727968 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013727968 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013727968 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013727968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013727969 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013727969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013727969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:37:29.382346 run osmo-stp_10.42.42.5(pid=9417): stdout: | (launched: 2022-12-10_01:37:27.799081) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:37:29.503521 run osmo-stp_10.42.42.5(pid=9417): stderr: | 20221210013727968 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013727968 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013727968 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013727968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013727969 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013727969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013727969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:37:29.646716 run patchelf(pid=9420): Terminating (SIGINT) 01:37:29.811403 run patchelf(pid=9420): Terminated: ok {rc=0} 01:37:29.930107 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9417): Process ended prematurely: osmo-stp_10.42.42.5(pid=9417) [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9417)] [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 01:37:29.939528 tst iperf3.py:8: Test FAILED (7.2 sec) 01:37:29.966447 run osmo-hlr_10.42.42.2(pid=9414): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9414)] 01:37:30.013939 run osmo-hlr_10.42.42.2(pid=9414): stdout: | (launched: 2022-12-10_01:37:26.882652) 01:37:30.062605 run osmo-hlr_10.42.42.2(pid=9414): stderr: | 20221210013727054 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013727054 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013727054 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013727054 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013727054 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013727054 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013727066 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013727077 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013727077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013727077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:37:30.111970 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9409): Terminating (SIGTERM) 01:37:30.151392 run iperf3-srv_10.42.42.10(pid=9410): Terminating (SIGTERM) 01:37:30.190839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9413): Terminating (SIGTERM) 01:37:30.230289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9416): Terminating (SIGTERM) 01:37:30.269593 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9419): Terminating (SIGTERM) 01:37:30.309309 --- ParallelTerminationStrategy: PID 9409 died... 01:37:30.328131 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9409): Terminated: ok {rc=0} 01:37:30.372573 --- ParallelTerminationStrategy: PID 9410 died... 01:37:30.390837 run iperf3-srv_10.42.42.10(pid=9410): Terminated {rc=256} 01:37:30.434579 --- ParallelTerminationStrategy: PID 9413 died... 01:37:30.452864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9413): Terminated: ok {rc=0} 01:37:30.496460 --- ParallelTerminationStrategy: PID 9416 died... 01:37:30.514866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9416): Terminated: ok {rc=0} 01:37:30.558697 --- ParallelTerminationStrategy: PID 9419 died... 01:37:30.577562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9419): Terminated: ok {rc=0} 01:37:30.660827 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 01:37:31.814324 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:31.827263 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:37:31.877132 tst iperf3m4.py: using LAC 25086 01:37:31.997815 tst iperf3m4.py: using RAC 96 01:37:32.118967 tst iperf3m4.py: using CellId 25086 01:37:32.239433 tst iperf3m4.py: using BVCI 25087 01:37:32.348936 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:32.360121 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:32.371114 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:32.382426 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:32.393940 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:32.404902 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:32.416041 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:32.426923 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:32.437995 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:37:32.558122 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:37:32.675680 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:37:32.792183 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:37:32.905260 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:37:33.102266 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:37:33.398803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9421): Launched 01:37:33.655598 run iperf3-srv_10.42.42.10(pid=9422): Launched 01:37:33.766800 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:37:33.963518 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:37:34.259907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9423): Launched 01:37:34.517290 run iperf3-srv_10.42.42.10(pid=9424): Launched 01:37:34.628646 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:37:34.825177 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:37:35.120653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9425): Launched 01:37:35.379025 run iperf3-srv_10.42.42.10(pid=9426): Launched 01:37:35.490382 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:37:35.686858 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:37:35.984420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9433): Launched 01:37:36.242256 run iperf3-srv_10.42.42.10(pid=9434): Launched 01:37:36.353537 tst iperf3m4.py:8: start network... 01:37:36.550206 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:37:37.006612 run create_hlr_db(pid=9435): Launched 01:37:37.120331 bus /gobi_6: Setting Powered False 01:37:38.178796 run create_hlr_db(pid=9435): Terminated: ok {rc=0} 01:37:38.591350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9437): Launched 01:37:38.886669 run osmo-hlr_10.42.42.2(pid=9438): Launched 01:37:38.999604 run osmo-stp_10.42.42.5: Starting osmo-stp 01:37:39.522490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9440): Launched 01:37:39.818795 run osmo-stp_10.42.42.5(pid=9441): Launched 01:37:39.932432 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:37:40.443244 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9443): Launched 01:37:40.556247 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:37:40.805719 run patchelf(pid=9444): Launched 01:37:40.971552 run osmo-stp_10.42.42.5(pid=9441): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9441)] 01:37:41.096890 run osmo-stp_10.42.42.5(pid=9441): stdout: | (launched: 2022-12-10_01:37:39.764074) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:37:41.224076 run osmo-stp_10.42.42.5(pid=9441): stderr: | 20221210013739930 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013739930 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013739930 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013739931 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013739931 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013739931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013739931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:37:41.352074 run osmo-stp_10.42.42.5(pid=9441): stdout: | (launched: 2022-12-10_01:37:39.764074) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:37:41.473792 run osmo-stp_10.42.42.5(pid=9441): stderr: | 20221210013739930 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013739930 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013739930 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013739931 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013739931 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013739931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013739931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:37:41.618422 run patchelf(pid=9444): Terminating (SIGINT) 01:37:41.784552 run patchelf(pid=9444): Terminated: ok {rc=0} 01:37:41.904537 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9441): Process ended prematurely: osmo-stp_10.42.42.5(pid=9441) [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9441)] [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 01:37:41.914068 tst iperf3m4.py:8: Test FAILED (10.1 sec) 01:37:41.941587 run osmo-hlr_10.42.42.2(pid=9438): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9438)] 01:37:41.988682 run osmo-hlr_10.42.42.2(pid=9438): stdout: | (launched: 2022-12-10_01:37:38.832217) 01:37:42.037706 run osmo-hlr_10.42.42.2(pid=9438): stderr: | 20221210013739005 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013739005 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013739005 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013739005 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013739005 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013739005 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013739017 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013739026 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013739026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013739026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:37:42.087116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9421): Terminating (SIGTERM) 01:37:42.126703 run iperf3-srv_10.42.42.10(pid=9422): Terminating (SIGTERM) 01:37:42.165991 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9423): Terminating (SIGTERM) 01:37:42.205609 run iperf3-srv_10.42.42.10(pid=9424): Terminating (SIGTERM) 01:37:42.244929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9425): Terminating (SIGTERM) 01:37:42.284347 run iperf3-srv_10.42.42.10(pid=9426): Terminating (SIGTERM) 01:37:42.323567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9433): Terminating (SIGTERM) 01:37:42.362916 run iperf3-srv_10.42.42.10(pid=9434): Terminating (SIGTERM) 01:37:42.401947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9437): Terminating (SIGTERM) 01:37:42.441496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9440): Terminating (SIGTERM) 01:37:42.480855 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9443): Terminating (SIGTERM) 01:37:42.520414 --- ParallelTerminationStrategy: PID 9421 died... 01:37:42.539123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9421): Terminated: ok {rc=0} 01:37:42.582871 --- ParallelTerminationStrategy: PID 9422 died... 01:37:42.601143 run iperf3-srv_10.42.42.10(pid=9422): Terminated {rc=256} 01:37:42.644706 --- ParallelTerminationStrategy: PID 9423 died... 01:37:42.663010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9423): Terminated: ok {rc=0} 01:37:42.706577 --- ParallelTerminationStrategy: PID 9424 died... 01:37:42.724787 run iperf3-srv_10.42.42.10(pid=9424): Terminated {rc=256} 01:37:42.768283 --- ParallelTerminationStrategy: PID 9425 died... 01:37:42.786763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9425): Terminated: ok {rc=0} 01:37:42.830341 --- ParallelTerminationStrategy: PID 9426 died... 01:37:42.848469 run iperf3-srv_10.42.42.10(pid=9426): Terminated {rc=256} 01:37:42.891852 --- ParallelTerminationStrategy: PID 9433 died... 01:37:42.910207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9433): Terminated: ok {rc=0} 01:37:42.953733 --- ParallelTerminationStrategy: PID 9434 died... 01:37:42.971946 run iperf3-srv_10.42.42.10(pid=9434): Terminated {rc=256} 01:37:43.015453 --- ParallelTerminationStrategy: PID 9437 died... 01:37:43.033867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9437): Terminated: ok {rc=0} 01:37:43.077764 --- ParallelTerminationStrategy: PID 9440 died... 01:37:43.096028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9440): Terminated: ok {rc=0} 01:37:43.139878 --- ParallelTerminationStrategy: PID 9443 died... 01:37:43.158252 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9443): Terminated: ok {rc=0} 01:37:43.240907 bus /gobi_4: Setting Powered False 01:37:44.338881 bus /gobi_4: Setting Powered False 01:37:45.454218 bus /gobi_1: Setting Powered False 01:37:46.551101 bus /gobi_1: Setting Powered False 01:37:47.673083 bus /gobi_0: Setting Powered False 01:37:48.771826 bus /gobi_0: Setting Powered False 01:37:49.884454 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 01:37:50.986670 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:50.998656 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:37:51.047996 tst ping.py: using LAC 25087 01:37:51.170583 tst ping.py: using RAC 97 01:37:51.291875 tst ping.py: using CellId 25087 01:37:51.415302 tst ping.py: using BVCI 25088 01:37:51.529239 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:51.540575 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:51.551764 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:51.563024 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:51.574226 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:51.585681 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:51.596924 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:51.608028 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:37:51.721555 tst ping.py:19: start network... 01:37:51.914326 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:37:52.362048 run create_hlr_db(pid=9445): Launched 01:37:52.473322 bus /gobi_6: Setting Powered False 01:37:53.531428 run create_hlr_db(pid=9445): Terminated: ok {rc=0} 01:37:53.954227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9447): Launched 01:37:54.263382 run osmo-hlr_10.42.42.2(pid=9448): Launched 01:37:54.382893 run osmo-stp_10.42.42.5: Starting osmo-stp 01:37:54.901123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9450): Launched 01:37:55.191267 run osmo-stp_10.42.42.5(pid=9451): Launched 01:37:55.303030 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:37:55.805026 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9453): Launched 01:37:55.917452 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:37:56.162393 run patchelf(pid=9454): Launched 01:37:56.324464 run osmo-stp_10.42.42.5(pid=9451): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9451)] 01:37:56.447279 run osmo-stp_10.42.42.5(pid=9451): stdout: | (launched: 2022-12-10_01:37:55.137917) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:37:56.571802 run osmo-stp_10.42.42.5(pid=9451): stderr: | 20221210013755304 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013755304 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013755305 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013755305 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013755306 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013755306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013755306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:37:56.696276 run osmo-stp_10.42.42.5(pid=9451): stdout: | (launched: 2022-12-10_01:37:55.137917) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:37:56.815851 run osmo-stp_10.42.42.5(pid=9451): stderr: | 20221210013755304 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013755304 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013755305 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013755305 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013755306 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013755306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013755306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:37:56.957580 run patchelf(pid=9454): Terminating (SIGINT) 01:37:57.120686 run patchelf(pid=9454): Terminated: ok {rc=0} 01:37:57.237894 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9451): Process ended prematurely: osmo-stp_10.42.42.5(pid=9451) [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9451)] [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 01:37:57.246648 tst ping.py:22: Test FAILED (6.3 sec) 01:37:57.273903 run osmo-hlr_10.42.42.2(pid=9448): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9448)] 01:37:57.321865 run osmo-hlr_10.42.42.2(pid=9448): stdout: | (launched: 2022-12-10_01:37:54.206561) 01:37:57.371421 run osmo-hlr_10.42.42.2(pid=9448): stderr: | 20221210013754401 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013754401 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013754402 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013754402 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013754402 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013754402 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013754414 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013754422 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013754422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013754422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:37:57.421735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9447): Terminating (SIGTERM) 01:37:57.462076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9450): Terminating (SIGTERM) 01:37:57.502086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9453): Terminating (SIGTERM) 01:37:57.542201 --- ParallelTerminationStrategy: PID 9447 died... 01:37:57.561438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9447): Terminated: ok {rc=0} 01:37:57.606206 --- ParallelTerminationStrategy: PID 9450 died... 01:37:57.624803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9450): Terminated: ok {rc=0} 01:37:57.669160 --- ParallelTerminationStrategy: PID 9453 died... 01:37:57.687807 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9453): Terminated: ok {rc=0} 01:37:57.771483 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 01:37:58.857500 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:58.869726 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:37:58.919801 tst ping_idle_ping.py: using LAC 25088 01:37:59.043452 tst ping_idle_ping.py: using RAC 98 01:37:59.166113 tst ping_idle_ping.py: using CellId 25088 01:37:59.288412 tst ping_idle_ping.py: using BVCI 25089 01:37:59.401943 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:59.413518 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:59.424612 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:59.436604 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:59.448386 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:59.460146 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:59.472051 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:59.484033 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:37:59.599482 tst ping_idle_ping.py:24: start network... 01:37:59.793502 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:38:00.245809 run create_hlr_db(pid=9455): Launched 01:38:00.358087 bus /gobi_6: Setting Powered False 01:38:01.448575 run create_hlr_db(pid=9455): Terminated: ok {rc=0} 01:38:01.970331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9457): Launched 01:38:02.294463 run osmo-hlr_10.42.42.2(pid=9458): Launched 01:38:02.416427 run osmo-stp_10.42.42.5: Starting osmo-stp 01:38:02.953077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9460): Launched 01:38:03.264479 run osmo-stp_10.42.42.5(pid=9461): Launched 01:38:03.383345 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:38:03.921262 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9463): Launched 01:38:04.040435 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:38:04.303489 run patchelf(pid=9464): Launched 01:38:04.477327 run osmo-stp_10.42.42.5(pid=9461): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9461)] 01:38:04.609460 run osmo-stp_10.42.42.5(pid=9461): stdout: | (launched: 2022-12-10_01:38:03.207494) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:38:04.743037 run osmo-stp_10.42.42.5(pid=9461): stderr: | 20221210013803399 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013803399 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013803399 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013803399 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013803400 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013803400 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013803400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:38:04.876715 run osmo-stp_10.42.42.5(pid=9461): stdout: | (launched: 2022-12-10_01:38:03.207494) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:38:05.004840 run osmo-stp_10.42.42.5(pid=9461): stderr: | 20221210013803399 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013803399 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013803399 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013803399 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013803400 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013803400 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013803400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:38:05.156719 run patchelf(pid=9464): Terminating (SIGINT) 01:38:05.331336 run patchelf(pid=9464): Terminated: ok {rc=0} 01:38:05.455713 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9461): Process ended prematurely: osmo-stp_10.42.42.5(pid=9461) [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9461)] [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 01:38:05.465296 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 01:38:05.493348 run osmo-hlr_10.42.42.2(pid=9458): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9458)] 01:38:05.542926 run osmo-hlr_10.42.42.2(pid=9458): stdout: | (launched: 2022-12-10_01:38:02.237656) 01:38:05.594655 run osmo-hlr_10.42.42.2(pid=9458): stderr: | 20221210013802431 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013802431 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013802431 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013802432 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013802432 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013802432 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013802444 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013802452 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013802453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013802453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:38:05.647044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9457): Terminating (SIGTERM) 01:38:05.688350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9460): Terminating (SIGTERM) 01:38:05.729834 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9463): Terminating (SIGTERM) 01:38:05.771367 --- ParallelTerminationStrategy: PID 9457 died... 01:38:05.791124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9457): Terminated: ok {rc=0} 01:38:05.837103 --- ParallelTerminationStrategy: PID 9460 died... 01:38:05.856765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9460): Terminated: ok {rc=0} 01:38:05.902396 --- ParallelTerminationStrategy: PID 9463 died... 01:38:05.921853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9463): Terminated: ok {rc=0} 01:38:06.009292 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 01:38:07.306933 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:38:07.314327 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 01:38:07.344049 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 01:38:07.382972 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 01:38:07.470963 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 01:38:07.500562 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 01:38:07.539691 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 01:38:08.136123 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 01:38:08.187424 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:08.198838 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:38:08.265627 tst cs_paging_gprs_active.py: using LAC 25089 01:38:08.391746 tst cs_paging_gprs_active.py: using RAC 99 01:38:08.516369 tst cs_paging_gprs_active.py: using CellId 25089 01:38:08.639676 tst cs_paging_gprs_active.py: using BVCI 25090 01:38:08.755557 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:08.766974 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:08.778197 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:08.789464 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:08.800651 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:08.811845 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:08.823184 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:08.834264 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:08.845562 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:38:08.961872 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:38:09.076159 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:38:09.275050 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:38:09.573303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9468): Launched 01:38:09.832145 run iperf3-srv_10.42.42.10(pid=9469): Launched 01:38:09.944400 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:38:10.142532 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:38:10.440183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9470): Launched 01:38:10.698403 run iperf3-srv_10.42.42.10(pid=9471): Launched 01:38:10.809626 tst cs_paging_gprs_active.py:38: start network... 01:38:11.007086 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:38:11.465258 run create_hlr_db(pid=9472): Launched 01:38:11.579169 bus /gobi_6: Setting Powered False 01:38:12.638192 run create_hlr_db(pid=9472): Terminated: ok {rc=0} 01:38:13.071660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9474): Launched 01:38:13.390106 run osmo-hlr_10.42.42.2(pid=9475): Launched 01:38:13.511217 run osmo-stp_10.42.42.5: Starting osmo-stp 01:38:14.058333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9477): Launched 01:38:14.375657 run osmo-stp_10.42.42.5(pid=9478): Launched 01:38:14.497267 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:38:15.045405 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9480): Launched 01:38:15.167599 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:38:15.437550 run patchelf(pid=9481): Launched 01:38:15.615766 run osmo-stp_10.42.42.5(pid=9478): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9478)] 01:38:15.750983 run osmo-stp_10.42.42.5(pid=9478): stdout: | (launched: 2022-12-10_01:38:14.317936) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:38:15.888545 run osmo-stp_10.42.42.5(pid=9478): stderr: | 20221210013814506 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013814506 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013814507 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013814507 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013814507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013814508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013814508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:38:16.027016 run osmo-stp_10.42.42.5(pid=9478): stdout: | (launched: 2022-12-10_01:38:14.317936) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:38:16.187107 run osmo-stp_10.42.42.5(pid=9478): stderr: | 20221210013814506 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013814506 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013814507 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013814507 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013814507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013814508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013814508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:38:16.362789 run patchelf(pid=9481): Terminating (SIGINT) 01:38:16.562458 run patchelf(pid=9481): Terminated: ok {rc=0} 01:38:16.693464 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9478): Process ended prematurely: osmo-stp_10.42.42.5(pid=9478) [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9478)] [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 01:38:16.703812 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 01:38:16.733161 run osmo-hlr_10.42.42.2(pid=9475): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9475)] 01:38:16.783528 run osmo-hlr_10.42.42.2(pid=9475): stdout: | (launched: 2022-12-10_01:38:13.332233) 01:38:16.835491 run osmo-hlr_10.42.42.2(pid=9475): stderr: | 20221210013813530 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013813530 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013813530 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013813530 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013813530 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013813530 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013813543 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013813552 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013813552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013813552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:38:16.887965 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9468): Terminating (SIGTERM) 01:38:16.930541 run iperf3-srv_10.42.42.10(pid=9469): Terminating (SIGTERM) 01:38:16.984128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9470): Terminating (SIGTERM) 01:38:17.028662 run iperf3-srv_10.42.42.10(pid=9471): Terminating (SIGTERM) 01:38:17.078506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9474): Terminating (SIGTERM) 01:38:17.129088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9477): Terminating (SIGTERM) 01:38:17.172693 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9480): Terminating (SIGTERM) 01:38:17.218064 --- ParallelTerminationStrategy: PID 9468 died... 01:38:17.238313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9468): Terminated: ok {rc=0} 01:38:17.284535 --- ParallelTerminationStrategy: PID 9469 died... 01:38:17.304249 run iperf3-srv_10.42.42.10(pid=9469): Terminated {rc=256} 01:38:17.350010 --- ParallelTerminationStrategy: PID 9470 died... 01:38:17.369786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9470): Terminated: ok {rc=0} 01:38:17.417490 --- ParallelTerminationStrategy: PID 9471 died... 01:38:17.437186 run iperf3-srv_10.42.42.10(pid=9471): Terminated {rc=256} 01:38:17.488011 --- ParallelTerminationStrategy: PID 9474 died... 01:38:17.511734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9474): Terminated: ok {rc=0} 01:38:17.562698 --- ParallelTerminationStrategy: PID 9477 died... 01:38:17.586885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9477): Terminated: ok {rc=0} 01:38:17.639588 --- ParallelTerminationStrategy: PID 9480 died... 01:38:17.661686 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9480): Terminated: ok {rc=0} 01:38:17.758286 bus /gobi_0: Setting Powered False 01:38:18.896455 bus /gobi_0: Setting Powered False 01:38:20.039448 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 01:38:21.187798 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:21.200419 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:38:21.269404 tst iperf3.py: using LAC 25090 01:38:21.391891 tst iperf3.py: using RAC 100 01:38:21.510359 tst iperf3.py: using CellId 25090 01:38:21.632240 tst iperf3.py: using BVCI 25091 01:38:21.745888 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:21.757819 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:21.769513 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:21.782631 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:21.794899 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:21.807517 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:21.821153 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:21.834303 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:21.846204 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:38:21.963832 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:38:22.165717 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:38:22.485936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9754): Launched 01:38:22.773414 run iperf3-srv_10.42.42.10(pid=9755): Launched 01:38:22.908688 tst iperf3.py:8: start network... 01:38:23.128634 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:38:23.635923 run create_hlr_db(pid=9756): Launched 01:38:23.800370 bus /gobi_6: Setting Powered False 01:38:24.866619 run create_hlr_db(pid=9756): Terminated: ok {rc=0} 01:38:25.328214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9758): Launched 01:38:25.673817 run osmo-hlr_10.42.42.2(pid=9759): Launched 01:38:25.931194 run osmo-stp_10.42.42.5: Starting osmo-stp 01:38:26.577124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9761): Launched 01:38:26.895430 run osmo-stp_10.42.42.5(pid=9762): Launched 01:38:27.123334 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:38:27.825559 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9764): Launched 01:38:27.955503 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:38:28.217593 run patchelf(pid=9765): Launched 01:38:28.413572 run osmo-stp_10.42.42.5(pid=9762): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9762)] 01:38:28.553880 run osmo-stp_10.42.42.5(pid=9762): stdout: | (launched: 2022-12-10_01:38:26.838814) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:38:28.694708 run osmo-stp_10.42.42.5(pid=9762): stderr: | 20221210013827170 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013827170 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013827171 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013827171 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013827171 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013827171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013827172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:38:28.836105 run osmo-stp_10.42.42.5(pid=9762): stdout: | (launched: 2022-12-10_01:38:26.838814) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:38:28.972564 run osmo-stp_10.42.42.5(pid=9762): stderr: | 20221210013827170 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013827170 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013827171 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013827171 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013827171 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013827171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013827172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:38:29.132364 run patchelf(pid=9765): Terminating (SIGINT) 01:38:29.318319 run patchelf(pid=9765): Terminated: ok {rc=0} 01:38:29.453467 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9762): Process ended prematurely: osmo-stp_10.42.42.5(pid=9762) [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9762)] [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 01:38:29.464654 tst iperf3.py:8: Test FAILED (8.3 sec) 01:38:29.495068 run osmo-hlr_10.42.42.2(pid=9759): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9759)] 01:38:29.547998 run osmo-hlr_10.42.42.2(pid=9759): stdout: | (launched: 2022-12-10_01:38:25.610821) 01:38:29.601705 run osmo-hlr_10.42.42.2(pid=9759): stderr: | 20221210013825922 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013825922 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013825922 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013825923 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013825923 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013825923 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013825948 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013825956 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013825961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013825961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:38:29.655656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9754): Terminating (SIGTERM) 01:38:29.700432 run iperf3-srv_10.42.42.10(pid=9755): Terminating (SIGTERM) 01:38:29.747647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9758): Terminating (SIGTERM) 01:38:29.792020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9761): Terminating (SIGTERM) 01:38:29.837288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9764): Terminating (SIGTERM) 01:38:29.881722 --- ParallelTerminationStrategy: PID 9754 died... 01:38:29.901903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9754): Terminated: ok {rc=0} 01:38:29.950353 --- ParallelTerminationStrategy: PID 9755 died... 01:38:29.970182 run iperf3-srv_10.42.42.10(pid=9755): Terminated {rc=256} 01:38:30.016918 --- ParallelTerminationStrategy: PID 9758 died... 01:38:30.037539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9758): Terminated: ok {rc=0} 01:38:30.084869 --- ParallelTerminationStrategy: PID 9761 died... 01:38:30.104831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9761): Terminated: ok {rc=0} 01:38:30.152577 --- ParallelTerminationStrategy: PID 9764 died... 01:38:30.172609 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9764): Terminated: ok {rc=0} 01:38:30.263293 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 01:38:31.465021 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:31.481690 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:38:31.559064 tst iperf3m4.py: using LAC 25091 01:38:31.722875 tst iperf3m4.py: using RAC 101 01:38:31.866003 tst iperf3m4.py: using CellId 25091 01:38:32.020685 tst iperf3m4.py: using BVCI 25092 01:38:32.178414 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:32.193581 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:32.210282 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:32.225991 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:32.239313 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:32.252733 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:32.267098 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:32.284874 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:32.300287 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:38:32.460356 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:38:32.607148 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:38:32.757476 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:38:32.896772 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:38:33.132694 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:38:33.450397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9766): Launched 01:38:33.736715 run iperf3-srv_10.42.42.10(pid=9767): Launched 01:38:33.869315 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:38:34.077112 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:38:34.390781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9768): Launched 01:38:34.675874 run iperf3-srv_10.42.42.10(pid=9769): Launched 01:38:34.807729 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:38:35.015441 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:38:35.327452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9770): Launched 01:38:35.611459 run iperf3-srv_10.42.42.10(pid=9771): Launched 01:38:35.744890 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:38:35.951562 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:38:36.263662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9772): Launched 01:38:36.552037 run iperf3-srv_10.42.42.10(pid=9773): Launched 01:38:36.684340 tst iperf3m4.py:8: start network... 01:38:36.892684 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:38:37.378403 run create_hlr_db(pid=9774): Launched 01:38:37.513704 bus /gobi_6: Setting Powered False 01:38:38.575159 run create_hlr_db(pid=9774): Terminated: ok {rc=0} 01:38:39.009512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9776): Launched 01:38:39.339082 run osmo-hlr_10.42.42.2(pid=9777): Launched 01:38:39.584072 run osmo-stp_10.42.42.5: Starting osmo-stp 01:38:40.312404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9779): Launched 01:38:40.650085 run osmo-stp_10.42.42.5(pid=9780): Launched 01:38:40.772388 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:38:41.325807 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9782): Launched 01:38:41.450368 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:38:41.722840 run patchelf(pid=9783): Launched 01:38:41.903513 run osmo-stp_10.42.42.5(pid=9780): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9780)] 01:38:42.039246 run osmo-stp_10.42.42.5(pid=9780): stdout: | (launched: 2022-12-10_01:38:40.584041) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:38:42.176254 run osmo-stp_10.42.42.5(pid=9780): stderr: | 20221210013840784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013840784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013840785 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013840785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013840786 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013840786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013840786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:38:42.313457 run osmo-stp_10.42.42.5(pid=9780): stdout: | (launched: 2022-12-10_01:38:40.584041) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:38:42.444927 run osmo-stp_10.42.42.5(pid=9780): stderr: | 20221210013840784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013840784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013840785 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013840785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013840786 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013840786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013840786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:38:42.600811 run patchelf(pid=9783): Terminating (SIGINT) 01:38:42.779048 run patchelf(pid=9783): Terminated: ok {rc=0} 01:38:42.907791 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9780): Process ended prematurely: osmo-stp_10.42.42.5(pid=9780) [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9780)] [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 01:38:42.918057 tst iperf3m4.py:8: Test FAILED (11.5 sec) 01:38:42.946877 run osmo-hlr_10.42.42.2(pid=9777): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9777)] 01:38:42.996339 run osmo-hlr_10.42.42.2(pid=9777): stdout: | (launched: 2022-12-10_01:38:39.276022) 01:38:43.047460 run osmo-hlr_10.42.42.2(pid=9777): stderr: | 20221210013839625 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013839625 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013839625 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013839625 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013839625 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013839625 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013839641 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013839654 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013839654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013839654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:38:43.098837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9766): Terminating (SIGTERM) 01:38:43.140264 run iperf3-srv_10.42.42.10(pid=9767): Terminating (SIGTERM) 01:38:43.181626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9768): Terminating (SIGTERM) 01:38:43.223185 run iperf3-srv_10.42.42.10(pid=9769): Terminating (SIGTERM) 01:38:43.264287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9770): Terminating (SIGTERM) 01:38:43.305725 run iperf3-srv_10.42.42.10(pid=9771): Terminating (SIGTERM) 01:38:43.346602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9772): Terminating (SIGTERM) 01:38:43.387677 run iperf3-srv_10.42.42.10(pid=9773): Terminating (SIGTERM) 01:38:43.428471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9776): Terminating (SIGTERM) 01:38:43.469731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9779): Terminating (SIGTERM) 01:38:43.511015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9782): Terminating (SIGTERM) 01:38:43.552510 --- ParallelTerminationStrategy: PID 9766 died... 01:38:43.572203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9766): Terminated: ok {rc=0} 01:38:43.617817 --- ParallelTerminationStrategy: PID 9767 died... 01:38:43.636940 run iperf3-srv_10.42.42.10(pid=9767): Terminated {rc=256} 01:38:43.682387 --- ParallelTerminationStrategy: PID 9768 died... 01:38:43.701663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9768): Terminated: ok {rc=0} 01:38:43.747285 --- ParallelTerminationStrategy: PID 9769 died... 01:38:43.766613 run iperf3-srv_10.42.42.10(pid=9769): Terminated {rc=256} 01:38:43.812563 --- ParallelTerminationStrategy: PID 9770 died... 01:38:43.832111 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9770): Terminated: ok {rc=0} 01:38:43.877815 --- ParallelTerminationStrategy: PID 9771 died... 01:38:43.897289 run iperf3-srv_10.42.42.10(pid=9771): Terminated {rc=256} 01:38:43.943027 --- ParallelTerminationStrategy: PID 9772 died... 01:38:43.962526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9772): Terminated: ok {rc=0} 01:38:44.008416 --- ParallelTerminationStrategy: PID 9773 died... 01:38:44.027916 run iperf3-srv_10.42.42.10(pid=9773): Terminated {rc=256} 01:38:44.073648 --- ParallelTerminationStrategy: PID 9776 died... 01:38:44.093072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9776): Terminated: ok {rc=0} 01:38:44.138778 --- ParallelTerminationStrategy: PID 9779 died... 01:38:44.158338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9779): Terminated: ok {rc=0} 01:38:44.204461 --- ParallelTerminationStrategy: PID 9782 died... 01:38:44.223991 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9782): Terminated: ok {rc=0} 01:38:44.310616 bus /gobi_4: Setting Powered False 01:38:45.409617 bus /gobi_4: Setting Powered False 01:38:46.527088 bus /gobi_1: Setting Powered False 01:38:47.626512 bus /gobi_1: Setting Powered False 01:38:48.741757 bus /gobi_0: Setting Powered False 01:38:49.839973 bus /gobi_0: Setting Powered False 01:38:50.955310 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 01:38:52.058534 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:52.070740 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:38:52.139186 tst ping.py: using LAC 25092 01:38:52.265052 tst ping.py: using RAC 102 01:38:52.390247 tst ping.py: using CellId 25092 01:38:52.514732 tst ping.py: using BVCI 25093 01:38:52.629311 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:52.640889 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:52.652289 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:52.663688 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:52.674961 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:52.686301 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:52.697710 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:52.708911 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:38:52.825850 tst ping.py:19: start network... 01:38:53.036802 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:38:53.524511 run create_hlr_db(pid=9784): Launched 01:38:53.653740 bus /gobi_6: Setting Powered False 01:38:54.715918 run create_hlr_db(pid=9784): Terminated: ok {rc=0} 01:38:55.137543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9786): Launched 01:38:55.434779 run osmo-hlr_10.42.42.2(pid=9787): Launched 01:38:55.550256 run osmo-stp_10.42.42.5: Starting osmo-stp 01:38:56.066379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9789): Launched 01:38:56.362427 run osmo-stp_10.42.42.5(pid=9790): Launched 01:38:56.478059 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:38:57.001711 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9792): Launched 01:38:57.114866 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:38:57.364423 run patchelf(pid=9793): Launched 01:38:57.529252 run osmo-stp_10.42.42.5(pid=9790): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9790)] 01:38:57.654209 run osmo-stp_10.42.42.5(pid=9790): stdout: | (launched: 2022-12-10_01:38:56.307116) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:38:57.780779 run osmo-stp_10.42.42.5(pid=9790): stderr: | 20221210013856480 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013856480 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013856480 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013856481 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013856481 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013856481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013856481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:38:57.907932 run osmo-stp_10.42.42.5(pid=9790): stdout: | (launched: 2022-12-10_01:38:56.307116) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:38:58.029659 run osmo-stp_10.42.42.5(pid=9790): stderr: | 20221210013856480 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013856480 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013856480 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013856481 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013856481 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013856481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013856481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:38:58.173947 run patchelf(pid=9793): Terminating (SIGINT) 01:38:58.339158 run patchelf(pid=9793): Terminated: ok {rc=0} 01:38:58.458395 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9790): Process ended prematurely: osmo-stp_10.42.42.5(pid=9790) [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9790)] [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 01:38:58.467139 tst ping.py:22: Test FAILED (6.4 sec) 01:38:58.494542 run osmo-hlr_10.42.42.2(pid=9787): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9787)] 01:38:58.542277 run osmo-hlr_10.42.42.2(pid=9787): stdout: | (launched: 2022-12-10_01:38:55.379727) 01:38:58.591773 run osmo-hlr_10.42.42.2(pid=9787): stderr: | 20221210013855556 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013855556 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013855556 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013855556 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013855556 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013855557 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013855569 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013855577 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013855577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013855577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:38:58.641667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9786): Terminating (SIGTERM) 01:38:58.681497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9789): Terminating (SIGTERM) 01:38:58.721498 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9792): Terminating (SIGTERM) 01:38:58.761697 --- ParallelTerminationStrategy: PID 9786 died... 01:38:58.780928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9786): Terminated: ok {rc=0} 01:38:58.825796 --- ParallelTerminationStrategy: PID 9789 died... 01:38:58.844246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9789): Terminated: ok {rc=0} 01:38:58.888636 --- ParallelTerminationStrategy: PID 9792 died... 01:38:58.907178 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9792): Terminated: ok {rc=0} 01:38:58.994390 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 01:39:00.082495 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:00.094976 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:39:00.166754 tst ping_idle_ping.py: using LAC 25093 01:39:00.282871 tst ping_idle_ping.py: using RAC 103 01:39:00.397805 tst ping_idle_ping.py: using CellId 25093 01:39:00.514709 tst ping_idle_ping.py: using BVCI 25094 01:39:00.622070 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:00.633250 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:00.644174 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:00.655499 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:00.666865 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:00.678257 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:00.689841 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:00.701222 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:39:00.821434 tst ping_idle_ping.py:24: start network... 01:39:01.042284 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:39:01.551928 run create_hlr_db(pid=9794): Launched 01:39:01.719478 bus /gobi_6: Setting Powered False 01:39:02.782467 run create_hlr_db(pid=9794): Terminated: ok {rc=0} 01:39:03.211975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9796): Launched 01:39:03.510506 run osmo-hlr_10.42.42.2(pid=9797): Launched 01:39:03.626760 run osmo-stp_10.42.42.5: Starting osmo-stp 01:39:04.154608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9799): Launched 01:39:04.452280 run osmo-stp_10.42.42.5(pid=9800): Launched 01:39:04.565778 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:39:05.080162 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9802): Launched 01:39:05.194411 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:39:05.445715 run patchelf(pid=9803): Launched 01:39:05.612393 run osmo-stp_10.42.42.5(pid=9800): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9800)] 01:39:05.738429 run osmo-stp_10.42.42.5(pid=9800): stdout: | (launched: 2022-12-10_01:39:04.396573) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:39:05.866070 run osmo-stp_10.42.42.5(pid=9800): stderr: | 20221210013904567 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013904568 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013904568 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013904568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013904570 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013904571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013904571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:39:05.993920 run osmo-stp_10.42.42.5(pid=9800): stdout: | (launched: 2022-12-10_01:39:04.396573) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:39:06.116587 run osmo-stp_10.42.42.5(pid=9800): stderr: | 20221210013904567 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013904568 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013904568 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013904568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013904570 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013904571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013904571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:39:06.262141 run patchelf(pid=9803): Terminating (SIGINT) 01:39:06.429099 run patchelf(pid=9803): Terminated: ok {rc=0} 01:39:06.548855 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9800): Process ended prematurely: osmo-stp_10.42.42.5(pid=9800) [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9800)] [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 01:39:06.557887 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 01:39:06.585180 run osmo-hlr_10.42.42.2(pid=9797): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9797)] 01:39:06.632495 run osmo-hlr_10.42.42.2(pid=9797): stdout: | (launched: 2022-12-10_01:39:03.455127) 01:39:06.681620 run osmo-hlr_10.42.42.2(pid=9797): stderr: | 20221210013903632 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013903632 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013903632 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013903632 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013903632 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013903632 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013903645 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013903654 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013903654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013903654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:39:06.731310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9796): Terminating (SIGTERM) 01:39:06.771001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9799): Terminating (SIGTERM) 01:39:06.810687 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9802): Terminating (SIGTERM) 01:39:06.850729 --- ParallelTerminationStrategy: PID 9796 died... 01:39:06.869807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9796): Terminated: ok {rc=0} 01:39:06.913811 --- ParallelTerminationStrategy: PID 9799 died... 01:39:06.932523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9799): Terminated: ok {rc=0} 01:39:06.976726 --- ParallelTerminationStrategy: PID 9802 died... 01:39:06.995387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9802): Terminated: ok {rc=0} 01:39:07.081709 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 01:39:08.382926 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:39:08.389077 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 01:39:08.418122 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 01:39:08.456465 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 01:39:08.543075 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 01:39:08.572008 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 01:39:08.610102 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 01:39:09.206565 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 01:39:09.256163 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:09.267385 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:39:09.333706 tst cs_paging_gprs_active.py: using LAC 25094 01:39:09.463529 tst cs_paging_gprs_active.py: using RAC 104 01:39:09.592885 tst cs_paging_gprs_active.py: using CellId 25094 01:39:09.719677 tst cs_paging_gprs_active.py: using BVCI 25095 01:39:09.836716 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:09.848415 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:09.859870 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:09.871865 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:09.883675 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:09.895403 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:09.907304 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:09.919084 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:09.931167 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:39:10.050141 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:39:10.166303 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:39:10.368918 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:39:10.672086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9808): Launched 01:39:10.935966 run iperf3-srv_10.42.42.10(pid=9809): Launched 01:39:11.050039 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:39:11.252025 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:39:11.555791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9810): Launched 01:39:11.820812 run iperf3-srv_10.42.42.10(pid=9811): Launched 01:39:11.935042 tst cs_paging_gprs_active.py:38: start network... 01:39:12.137828 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:39:12.606441 run create_hlr_db(pid=9812): Launched 01:39:12.725279 bus /gobi_6: Setting Powered False 01:39:13.785558 run create_hlr_db(pid=9812): Terminated: ok {rc=0} 01:39:14.228612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9814): Launched 01:39:14.551655 run osmo-hlr_10.42.42.2(pid=9815): Launched 01:39:14.678293 run osmo-stp_10.42.42.5: Starting osmo-stp 01:39:15.241150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9817): Launched 01:39:15.566451 run osmo-stp_10.42.42.5(pid=9818): Launched 01:39:15.693848 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:39:16.251998 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9820): Launched 01:39:16.377320 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:39:16.649856 run patchelf(pid=9821): Launched 01:39:16.839014 run osmo-stp_10.42.42.5(pid=9818): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9818)] 01:39:16.972553 run osmo-stp_10.42.42.5(pid=9818): stdout: | (launched: 2022-12-10_01:39:15.507050) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:39:17.106576 run osmo-stp_10.42.42.5(pid=9818): stderr: | 20221210013915700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013915700 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013915701 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013915701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013915701 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013915701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013915702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:39:17.240649 run osmo-stp_10.42.42.5(pid=9818): stdout: | (launched: 2022-12-10_01:39:15.507050) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:39:17.365149 run osmo-stp_10.42.42.5(pid=9818): stderr: | 20221210013915700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013915700 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013915701 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013915701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013915701 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013915701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013915702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:39:17.511811 run patchelf(pid=9821): Terminating (SIGINT) 01:39:17.682390 run patchelf(pid=9821): Terminated: ok {rc=0} 01:39:17.805324 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9818): Process ended prematurely: osmo-stp_10.42.42.5(pid=9818) [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9818)] [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 01:39:17.815095 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 01:39:17.842952 run osmo-hlr_10.42.42.2(pid=9815): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9815)] 01:39:17.891345 run osmo-hlr_10.42.42.2(pid=9815): stdout: | (launched: 2022-12-10_01:39:14.492273) 01:39:17.940894 run osmo-hlr_10.42.42.2(pid=9815): stderr: | 20221210013914690 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013914690 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013914690 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013914690 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013914690 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013914690 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013914703 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013914713 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013914713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013914714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:39:17.990974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9808): Terminating (SIGTERM) 01:39:18.030975 run iperf3-srv_10.42.42.10(pid=9809): Terminating (SIGTERM) 01:39:18.070966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9810): Terminating (SIGTERM) 01:39:18.111114 run iperf3-srv_10.42.42.10(pid=9811): Terminating (SIGTERM) 01:39:18.151089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9814): Terminating (SIGTERM) 01:39:18.190776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9817): Terminating (SIGTERM) 01:39:18.230610 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9820): Terminating (SIGTERM) 01:39:18.271403 --- ParallelTerminationStrategy: PID 9808 died... 01:39:18.290583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9808): Terminated: ok {rc=0} 01:39:18.334883 --- ParallelTerminationStrategy: PID 9809 died... 01:39:18.353615 run iperf3-srv_10.42.42.10(pid=9809): Terminated {rc=256} 01:39:18.398009 --- ParallelTerminationStrategy: PID 9810 died... 01:39:18.416719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9810): Terminated: ok {rc=0} 01:39:18.461146 --- ParallelTerminationStrategy: PID 9811 died... 01:39:18.479726 run iperf3-srv_10.42.42.10(pid=9811): Terminated {rc=256} 01:39:18.524085 --- ParallelTerminationStrategy: PID 9814 died... 01:39:18.542860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9814): Terminated: ok {rc=0} 01:39:18.587136 --- ParallelTerminationStrategy: PID 9817 died... 01:39:18.605909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9817): Terminated: ok {rc=0} 01:39:18.650389 --- ParallelTerminationStrategy: PID 9820 died... 01:39:18.669135 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9820): Terminated: ok {rc=0} 01:39:18.755497 bus /gobi_0: Setting Powered False 01:39:19.855216 bus /gobi_0: Setting Powered False 01:39:20.971080 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 01:39:22.117629 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:22.129743 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:39:22.196583 tst iperf3.py: using LAC 25095 01:39:22.314366 tst iperf3.py: using RAC 105 01:39:22.431944 tst iperf3.py: using CellId 25095 01:39:22.550922 tst iperf3.py: using BVCI 25096 01:39:22.659399 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:22.670607 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:22.681928 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:22.693048 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:22.704142 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:22.715157 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:22.726456 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:22.737707 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:22.749465 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:39:22.864336 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:39:23.066798 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:39:23.368490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9822): Launched 01:39:23.631438 run iperf3-srv_10.42.42.10(pid=9823): Launched 01:39:23.745310 tst iperf3.py:8: start network... 01:39:23.946460 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:39:24.413585 run create_hlr_db(pid=9824): Launched 01:39:24.530139 bus /gobi_6: Setting Powered False 01:39:25.590335 run create_hlr_db(pid=9824): Terminated: ok {rc=0} 01:39:26.030126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9826): Launched 01:39:26.356146 run osmo-hlr_10.42.42.2(pid=9827): Launched 01:39:26.481457 run osmo-stp_10.42.42.5: Starting osmo-stp 01:39:27.043172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9829): Launched 01:39:27.369049 run osmo-stp_10.42.42.5(pid=9830): Launched 01:39:27.493653 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:39:28.051682 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9832): Launched 01:39:28.175145 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:39:28.448237 run patchelf(pid=9833): Launched 01:39:28.627523 run osmo-stp_10.42.42.5(pid=9830): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9830)] 01:39:28.763118 run osmo-stp_10.42.42.5(pid=9830): stdout: | (launched: 2022-12-10_01:39:27.309343) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:39:28.900719 run osmo-stp_10.42.42.5(pid=9830): stderr: | 20221210013927501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013927501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013927501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013927502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013927504 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013927504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013927504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:39:29.038300 run osmo-stp_10.42.42.5(pid=9830): stdout: | (launched: 2022-12-10_01:39:27.309343) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:39:29.170461 run osmo-stp_10.42.42.5(pid=9830): stderr: | 20221210013927501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013927501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013927501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013927502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013927504 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013927504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013927504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:39:29.327602 run patchelf(pid=9833): Terminating (SIGINT) 01:39:29.507004 run patchelf(pid=9833): Terminated: ok {rc=0} 01:39:29.636248 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9830): Process ended prematurely: osmo-stp_10.42.42.5(pid=9830) [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9830)] [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 01:39:29.646574 tst iperf3.py:8: Test FAILED (7.6 sec) 01:39:29.675219 run osmo-hlr_10.42.42.2(pid=9827): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9827)] 01:39:29.724793 run osmo-hlr_10.42.42.2(pid=9827): stdout: | (launched: 2022-12-10_01:39:26.296749) 01:39:29.776381 run osmo-hlr_10.42.42.2(pid=9827): stderr: | 20221210013926495 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013926495 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013926495 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013926495 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013926495 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013926495 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013926508 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013926518 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013926518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013926518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:39:29.828705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9822): Terminating (SIGTERM) 01:39:29.870453 run iperf3-srv_10.42.42.10(pid=9823): Terminating (SIGTERM) 01:39:29.912073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9826): Terminating (SIGTERM) 01:39:29.953742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9829): Terminating (SIGTERM) 01:39:29.995373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9832): Terminating (SIGTERM) 01:39:30.037337 --- ParallelTerminationStrategy: PID 9822 died... 01:39:30.057335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9822): Terminated: ok {rc=0} 01:39:30.103655 --- ParallelTerminationStrategy: PID 9823 died... 01:39:30.123142 run iperf3-srv_10.42.42.10(pid=9823): Terminated {rc=256} 01:39:30.169157 --- ParallelTerminationStrategy: PID 9826 died... 01:39:30.188586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9826): Terminated: ok {rc=0} 01:39:30.234824 --- ParallelTerminationStrategy: PID 9829 died... 01:39:30.254438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9829): Terminated: ok {rc=0} 01:39:30.300598 --- ParallelTerminationStrategy: PID 9832 died... 01:39:30.320532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9832): Terminated: ok {rc=0} 01:39:30.408759 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 01:39:31.557390 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:31.570027 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:39:31.637974 tst iperf3m4.py: using LAC 25096 01:39:31.759417 tst iperf3m4.py: using RAC 106 01:39:31.923042 tst iperf3m4.py: using CellId 25096 01:39:32.053580 tst iperf3m4.py: using BVCI 25097 01:39:32.175140 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:32.187856 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:32.200397 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:32.215919 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:32.229155 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:32.241456 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:32.254457 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:32.267045 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:32.280442 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:39:32.397739 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:39:32.520059 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:39:32.636417 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:39:32.751343 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:39:32.954546 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:39:33.257768 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9835): Launched 01:39:33.522926 run iperf3-srv_10.42.42.10(pid=9836): Launched 01:39:33.639851 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:39:33.843000 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:39:34.148010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9837): Launched 01:39:34.411829 run iperf3-srv_10.42.42.10(pid=9838): Launched 01:39:34.526395 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:39:34.728058 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:39:35.031039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9839): Launched 01:39:35.295454 run iperf3-srv_10.42.42.10(pid=9840): Launched 01:39:35.410208 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:39:35.611660 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:39:35.915239 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9841): Launched 01:39:36.180030 run iperf3-srv_10.42.42.10(pid=9842): Launched 01:39:36.294820 tst iperf3m4.py:8: start network... 01:39:36.496194 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:39:36.963727 run create_hlr_db(pid=9843): Launched 01:39:37.080329 bus /gobi_6: Setting Powered False 01:39:38.141072 run create_hlr_db(pid=9843): Terminated: ok {rc=0} 01:39:38.583126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9845): Launched 01:39:38.906728 run osmo-hlr_10.42.42.2(pid=9846): Launched 01:39:39.031734 run osmo-stp_10.42.42.5: Starting osmo-stp 01:39:39.589766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9848): Launched 01:39:39.912705 run osmo-stp_10.42.42.5(pid=9849): Launched 01:39:40.039435 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:39:40.599540 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9851): Launched 01:39:40.724190 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:39:40.996860 run patchelf(pid=9852): Launched 01:39:41.178005 run osmo-stp_10.42.42.5(pid=9849): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9849)] 01:39:41.314849 run osmo-stp_10.42.42.5(pid=9849): stdout: | (launched: 2022-12-10_01:39:39.853361) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:39:41.453158 run osmo-stp_10.42.42.5(pid=9849): stderr: | 20221210013940047 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013940047 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013940047 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013940048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013940048 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013940048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013940049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:39:41.591307 run osmo-stp_10.42.42.5(pid=9849): stdout: | (launched: 2022-12-10_01:39:39.853361) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:39:41.723515 run osmo-stp_10.42.42.5(pid=9849): stderr: | 20221210013940047 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013940047 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013940047 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013940048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013940048 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013940048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013940049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:39:41.880388 run patchelf(pid=9852): Terminating (SIGINT) 01:39:42.060686 run patchelf(pid=9852): Terminated: ok {rc=0} 01:39:42.190477 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9849): Process ended prematurely: osmo-stp_10.42.42.5(pid=9849) [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9849)] [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 01:39:42.200786 tst iperf3m4.py:8: Test FAILED (10.7 sec) 01:39:42.230107 run osmo-hlr_10.42.42.2(pid=9846): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9846)] 01:39:42.280397 run osmo-hlr_10.42.42.2(pid=9846): stdout: | (launched: 2022-12-10_01:39:38.847467) 01:39:42.332230 run osmo-hlr_10.42.42.2(pid=9846): stderr: | 20221210013939047 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013939047 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013939047 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013939047 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013939047 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013939048 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013939060 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013939068 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013939069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013939069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:39:42.384731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9835): Terminating (SIGTERM) 01:39:42.426746 run iperf3-srv_10.42.42.10(pid=9836): Terminating (SIGTERM) 01:39:42.468469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9837): Terminating (SIGTERM) 01:39:42.510632 run iperf3-srv_10.42.42.10(pid=9838): Terminating (SIGTERM) 01:39:42.552121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9839): Terminating (SIGTERM) 01:39:42.593867 run iperf3-srv_10.42.42.10(pid=9840): Terminating (SIGTERM) 01:39:42.635363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9841): Terminating (SIGTERM) 01:39:42.677238 run iperf3-srv_10.42.42.10(pid=9842): Terminating (SIGTERM) 01:39:42.718640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9845): Terminating (SIGTERM) 01:39:42.760440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9848): Terminating (SIGTERM) 01:39:42.802294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9851): Terminating (SIGTERM) 01:39:42.844163 --- ParallelTerminationStrategy: PID 9835 died... 01:39:42.864141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9835): Terminated: ok {rc=0} 01:39:42.910289 --- ParallelTerminationStrategy: PID 9836 died... 01:39:42.929798 run iperf3-srv_10.42.42.10(pid=9836): Terminated {rc=256} 01:39:42.975441 --- ParallelTerminationStrategy: PID 9837 died... 01:39:42.994901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9837): Terminated: ok {rc=0} 01:39:43.040652 --- ParallelTerminationStrategy: PID 9838 died... 01:39:43.060268 run iperf3-srv_10.42.42.10(pid=9838): Terminated {rc=256} 01:39:43.106784 --- ParallelTerminationStrategy: PID 9839 died... 01:39:43.126406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9839): Terminated: ok {rc=0} 01:39:43.172310 --- ParallelTerminationStrategy: PID 9840 died... 01:39:43.191871 run iperf3-srv_10.42.42.10(pid=9840): Terminated {rc=256} 01:39:43.238297 --- ParallelTerminationStrategy: PID 9841 died... 01:39:43.258000 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9841): Terminated: ok {rc=0} 01:39:43.304090 --- ParallelTerminationStrategy: PID 9842 died... 01:39:43.323493 run iperf3-srv_10.42.42.10(pid=9842): Terminated {rc=256} 01:39:43.369397 --- ParallelTerminationStrategy: PID 9845 died... 01:39:43.389052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9845): Terminated: ok {rc=0} 01:39:43.435206 --- ParallelTerminationStrategy: PID 9848 died... 01:39:43.454935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9848): Terminated: ok {rc=0} 01:39:43.501028 --- ParallelTerminationStrategy: PID 9851 died... 01:39:43.520757 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9851): Terminated: ok {rc=0} 01:39:43.607885 bus /gobi_4: Setting Powered False 01:39:44.706676 bus /gobi_4: Setting Powered False 01:39:45.823198 bus /gobi_1: Setting Powered False 01:39:46.924364 bus /gobi_1: Setting Powered False 01:39:48.038982 bus /gobi_0: Setting Powered False 01:39:49.137293 bus /gobi_0: Setting Powered False 01:39:50.253499 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 01:39:51.356610 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:51.369160 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:39:51.438582 tst ping.py: using LAC 25097 01:39:51.564049 tst ping.py: using RAC 107 01:39:51.688163 tst ping.py: using CellId 25097 01:39:51.811649 tst ping.py: using BVCI 25098 01:39:51.926885 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:51.938485 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:51.949930 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:51.961486 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:51.972757 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:51.984205 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:51.995744 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:52.007185 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:39:52.121805 tst ping.py:19: start network... 01:39:52.319167 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:39:52.778436 run create_hlr_db(pid=9853): Launched 01:39:52.894492 bus /gobi_6: Setting Powered False 01:39:53.953937 run create_hlr_db(pid=9853): Terminated: ok {rc=0} 01:39:54.387078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9855): Launched 01:39:54.706152 run osmo-hlr_10.42.42.2(pid=9856): Launched 01:39:54.828243 run osmo-stp_10.42.42.5: Starting osmo-stp 01:39:55.377714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9858): Launched 01:39:55.696318 run osmo-stp_10.42.42.5(pid=9859): Launched 01:39:55.817404 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:39:56.369616 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9861): Launched 01:39:56.493443 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:39:56.761919 run patchelf(pid=9862): Launched 01:39:56.939787 run osmo-stp_10.42.42.5(pid=9859): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9859)] 01:39:57.073172 run osmo-stp_10.42.42.5(pid=9859): stdout: | (launched: 2022-12-10_01:39:55.637569) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:39:57.208579 run osmo-stp_10.42.42.5(pid=9859): stderr: | 20221210013955832 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013955832 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013955832 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013955833 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013955833 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013955833 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013955833 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:39:57.344673 run osmo-stp_10.42.42.5(pid=9859): stdout: | (launched: 2022-12-10_01:39:55.637569) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:39:57.474617 run osmo-stp_10.42.42.5(pid=9859): stderr: | 20221210013955832 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210013955832 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210013955832 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210013955833 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210013955833 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210013955833 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210013955833 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:39:57.628243 run patchelf(pid=9862): Terminating (SIGINT) 01:39:57.804367 run patchelf(pid=9862): Terminated: ok {rc=0} 01:39:57.931761 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9859): Process ended prematurely: osmo-stp_10.42.42.5(pid=9859) [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9859)] [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 01:39:57.941278 tst ping.py:22: Test FAILED (6.6 sec) 01:39:57.969371 run osmo-hlr_10.42.42.2(pid=9856): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9856)] 01:39:58.019224 run osmo-hlr_10.42.42.2(pid=9856): stdout: | (launched: 2022-12-10_01:39:54.647540) 01:39:58.070798 run osmo-hlr_10.42.42.2(pid=9856): stderr: | 20221210013954845 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210013954845 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210013954845 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210013954845 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210013954845 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210013954845 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210013954858 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210013954866 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210013954866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210013954866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:39:58.122809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9855): Terminating (SIGTERM) 01:39:58.164395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9858): Terminating (SIGTERM) 01:39:58.206463 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9861): Terminating (SIGTERM) 01:39:58.248518 --- ParallelTerminationStrategy: PID 9855 died... 01:39:58.268607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9855): Terminated: ok {rc=0} 01:39:58.314943 --- ParallelTerminationStrategy: PID 9858 died... 01:39:58.334431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9858): Terminated: ok {rc=0} 01:39:58.380529 --- ParallelTerminationStrategy: PID 9861 died... 01:39:58.400307 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9861): Terminated: ok {rc=0} 01:39:58.489032 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 01:39:59.575980 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:59.588899 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:39:59.659439 tst ping_idle_ping.py: using LAC 25098 01:39:59.785445 tst ping_idle_ping.py: using RAC 108 01:39:59.908830 tst ping_idle_ping.py: using CellId 25098 01:40:00.033324 tst ping_idle_ping.py: using BVCI 25099 01:40:00.149597 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:00.161338 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:00.172875 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:00.184506 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:00.196140 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:00.207710 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:00.219422 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:00.231213 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:40:00.348760 tst ping_idle_ping.py:24: start network... 01:40:00.549475 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:40:01.029717 run create_hlr_db(pid=9864): Launched 01:40:01.190528 bus /gobi_6: Setting Powered False 01:40:02.253098 run create_hlr_db(pid=9864): Terminated: ok {rc=0} 01:40:02.680145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9868): Launched 01:40:02.978647 run osmo-hlr_10.42.42.2(pid=9869): Launched 01:40:03.096125 run osmo-stp_10.42.42.5: Starting osmo-stp 01:40:03.620303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9871): Launched 01:40:03.918383 run osmo-stp_10.42.42.5(pid=9872): Launched 01:40:04.032799 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:40:04.546656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9874): Launched 01:40:04.660401 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:40:04.912259 run patchelf(pid=9875): Launched 01:40:05.078588 run osmo-stp_10.42.42.5(pid=9872): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9872)] 01:40:05.204356 run osmo-stp_10.42.42.5(pid=9872): stdout: | (launched: 2022-12-10_01:40:03.863141) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:40:05.332394 run osmo-stp_10.42.42.5(pid=9872): stderr: | 20221210014004032 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014004032 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014004032 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014004033 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014004033 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014004033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014004033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:40:05.460008 run osmo-stp_10.42.42.5(pid=9872): stdout: | (launched: 2022-12-10_01:40:03.863141) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:40:05.582603 run osmo-stp_10.42.42.5(pid=9872): stderr: | 20221210014004032 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014004032 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014004032 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014004033 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014004033 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014004033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014004033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:40:05.726978 run patchelf(pid=9875): Terminating (SIGINT) 01:40:05.893580 run patchelf(pid=9875): Terminated: ok {rc=0} 01:40:06.013124 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9872): Process ended prematurely: osmo-stp_10.42.42.5(pid=9872) [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9872)] [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 01:40:06.022076 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 01:40:06.049531 run osmo-hlr_10.42.42.2(pid=9869): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9869)] 01:40:06.097463 run osmo-hlr_10.42.42.2(pid=9869): stdout: | (launched: 2022-12-10_01:40:02.923354) 01:40:06.146983 run osmo-hlr_10.42.42.2(pid=9869): stderr: | 20221210014003097 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014003097 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014003097 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014003097 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014003097 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014003097 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014003110 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014003118 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014003119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014003119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:40:06.196866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9868): Terminating (SIGTERM) 01:40:06.236627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9871): Terminating (SIGTERM) 01:40:06.276362 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9874): Terminating (SIGTERM) 01:40:06.316373 --- ParallelTerminationStrategy: PID 9868 died... 01:40:06.335442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9868): Terminated: ok {rc=0} 01:40:06.379536 --- ParallelTerminationStrategy: PID 9871 died... 01:40:06.398112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9871): Terminated: ok {rc=0} 01:40:06.442326 --- ParallelTerminationStrategy: PID 9874 died... 01:40:06.460911 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9874): Terminated: ok {rc=0} 01:40:06.546971 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:40:07.851588 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:40:07.858530 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:40:07.888350 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 01:40:07.922477 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:40:07.975032 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:40:08.003865 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 01:40:08.038342 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:40:08.602770 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2367 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 01:40:08.609176 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:40:08.621569 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:40:08.690284 tst switch_tch_pdch.py: using LAC 25099 01:40:08.817269 tst switch_tch_pdch.py: using RAC 109 01:40:08.941439 tst switch_tch_pdch.py: using CellId 25099 01:40:09.064440 tst switch_tch_pdch.py: using BVCI 25100 01:40:09.181072 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:40:09.192788 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:40:09.204415 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:40:09.216591 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:40:09.228726 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:40:09.241264 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:40:09.253475 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:40:09.265540 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:40:09.383063 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:40:09.501163 tst switch_tch_pdch.py:51: start network... 01:40:09.714420 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:40:10.205412 run create_hlr_db(pid=9879): Launched 01:40:10.338260 bus /gobi_6: Setting Powered False 01:40:11.402142 run create_hlr_db(pid=9879): Terminated: ok {rc=0} 01:40:11.843693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9881): Launched 01:40:12.162922 run osmo-hlr_10.42.42.2(pid=9882): Launched 01:40:12.285800 run osmo-stp_10.42.42.5: Starting osmo-stp 01:40:12.836102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9884): Launched 01:40:13.155293 run osmo-stp_10.42.42.5(pid=9885): Launched 01:40:13.279641 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:40:13.827637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9887): Launched 01:40:13.951484 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:40:14.220109 run patchelf(pid=9888): Launched 01:40:14.399640 run osmo-stp_10.42.42.5(pid=9885): ERR: Terminated: ERROR {rc=1} [trial-2367↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9885)] 01:40:14.534733 run osmo-stp_10.42.42.5(pid=9885): stdout: | (launched: 2022-12-10_01:40:13.096598) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:40:14.671101 run osmo-stp_10.42.42.5(pid=9885): stderr: | 20221210014013287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014013287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014013287 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014013287 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014013290 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014013290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014013290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:40:14.807115 run osmo-stp_10.42.42.5(pid=9885): stdout: | (launched: 2022-12-10_01:40:13.096598) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:40:14.938086 run osmo-stp_10.42.42.5(pid=9885): stderr: | 20221210014013287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014013287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014013287 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014013287 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014013290 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014013290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014013290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:40:15.092198 run patchelf(pid=9888): Terminating (SIGINT) 01:40:15.269488 run patchelf(pid=9888): Terminated: ok {rc=0} 01:40:15.396832 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=9885): Process ended prematurely: osmo-stp_10.42.42.5(pid=9885) [trial-2367↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9885)] [trial-2367↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 01:40:15.406699 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 01:40:15.435428 run osmo-hlr_10.42.42.2(pid=9882): ERR: Terminated: ERROR {rc=237} [trial-2367↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9882)] 01:40:15.485252 run osmo-hlr_10.42.42.2(pid=9882): stdout: | (launched: 2022-12-10_01:40:12.104207) 01:40:15.536841 run osmo-hlr_10.42.42.2(pid=9882): stderr: | 20221210014012305 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014012305 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014012305 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014012305 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014012305 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014012305 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014012317 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014012326 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014012326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014012326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:40:15.588716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9881): Terminating (SIGTERM) 01:40:15.630320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9884): Terminating (SIGTERM) 01:40:15.671950 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9887): Terminating (SIGTERM) 01:40:15.713930 --- ParallelTerminationStrategy: PID 9881 died... 01:40:15.733978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9881): Terminated: ok {rc=0} 01:40:15.780147 --- ParallelTerminationStrategy: PID 9884 died... 01:40:15.800032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9884): Terminated: ok {rc=0} 01:40:15.848049 --- ParallelTerminationStrategy: PID 9887 died... 01:40:15.868394 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9887): Terminated: ok {rc=0} 01:40:15.957961 bus /gobi_0: Setting Powered False 01:40:17.066410 bus /gobi_0: Setting Powered False 01:40:18.181144 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 01:40:19.439406 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:40:19.445572 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 01:40:19.475147 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 01:40:19.510298 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 01:40:19.566006 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 01:40:19.596140 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 01:40:19.630901 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 01:40:20.187733 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2367 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 01:40:20.192903 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:40:20.204441 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 01:40:20.272034 tst switch_tch_pdch.py: using LAC 25100 01:40:20.389334 tst switch_tch_pdch.py: using RAC 110 01:40:20.507151 tst switch_tch_pdch.py: using CellId 25100 01:40:20.623571 tst switch_tch_pdch.py: using BVCI 25101 01:40:20.730855 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:40:20.742268 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:40:20.753389 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:40:20.764744 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:40:20.776225 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:40:20.787712 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:40:20.799326 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:40:20.810735 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 01:40:20.925839 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 01:40:21.039640 tst switch_tch_pdch.py:51: start network... 01:40:21.237663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:40:21.671399 run create_hlr_db(pid=9893): Launched 01:40:21.785399 bus /gobi_6: Setting Powered False 01:40:22.844599 run create_hlr_db(pid=9893): Terminated: ok {rc=0} 01:40:23.251305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9895): Launched 01:40:23.570611 run osmo-hlr_10.42.42.2(pid=9896): Launched 01:40:23.692080 run osmo-stp_10.42.42.5: Starting osmo-stp 01:40:24.209146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9898): Launched 01:40:24.525729 run osmo-stp_10.42.42.5(pid=9899): Launched 01:40:24.648153 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:40:25.167773 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9901): Launched 01:40:25.290417 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:40:25.557360 run patchelf(pid=9902): Launched 01:40:25.734270 run osmo-stp_10.42.42.5(pid=9899): ERR: Terminated: ERROR {rc=1} [trial-2367↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9899)] 01:40:25.867846 run osmo-stp_10.42.42.5(pid=9899): stdout: | (launched: 2022-12-10_01:40:24.467251) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:40:26.003284 run osmo-stp_10.42.42.5(pid=9899): stderr: | 20221210014024659 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014024659 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014024660 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014024660 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014024663 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014024663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014024663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:40:26.138651 run osmo-stp_10.42.42.5(pid=9899): stdout: | (launched: 2022-12-10_01:40:24.467251) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:40:26.269149 run osmo-stp_10.42.42.5(pid=9899): stderr: | 20221210014024659 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014024659 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014024660 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014024660 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014024663 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014024663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014024663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:40:26.423234 run patchelf(pid=9902): Terminating (SIGINT) 01:40:26.600219 run patchelf(pid=9902): Terminated: ok {rc=0} 01:40:26.728423 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=9899): Process ended prematurely: osmo-stp_10.42.42.5(pid=9899) [trial-2367↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9899)] [trial-2367↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 01:40:26.738107 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 01:40:26.766209 run osmo-hlr_10.42.42.2(pid=9896): ERR: Terminated: ERROR {rc=237} [trial-2367↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9896)] 01:40:26.815858 run osmo-hlr_10.42.42.2(pid=9896): stdout: | (launched: 2022-12-10_01:40:23.511623) 01:40:26.867382 run osmo-hlr_10.42.42.2(pid=9896): stderr: | 20221210014023710 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014023710 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014023711 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014023711 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014023711 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014023711 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014023723 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014023731 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014023732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014023732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:40:26.919131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9895): Terminating (SIGTERM) 01:40:26.960667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9898): Terminating (SIGTERM) 01:40:27.002242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9901): Terminating (SIGTERM) 01:40:27.044113 --- ParallelTerminationStrategy: PID 9895 died... 01:40:27.063965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9895): Terminated: ok {rc=0} 01:40:27.110010 --- ParallelTerminationStrategy: PID 9898 died... 01:40:27.129405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9898): Terminated: ok {rc=0} 01:40:27.175074 --- ParallelTerminationStrategy: PID 9901 died... 01:40:27.194508 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9901): Terminated: ok {rc=0} 01:40:27.281246 bus /gobi_0: Setting Powered False 01:40:28.380752 bus /gobi_0: Setting Powered False 01:40:29.496191 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 nitb_sms:nanobts --------------------------------------------------------------------- 01:40:30.760363 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:40:30.765156 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 01:40:30.789694 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 01:40:30.796819 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 01:40:30.876893 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 01:40:30.906156 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 01:40:30.918318 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 01:40:31.456273 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 01:40:31.462317 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 01:40:31.479629 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 01:40:31.524737 tst mo_mt_sms.py: using LAC 25101 01:40:31.651164 tst mo_mt_sms.py: using RAC 111 01:40:31.816546 tst mo_mt_sms.py: using CellId 25101 01:40:31.941389 tst mo_mt_sms.py: using BVCI 25102 01:40:32.097905 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 01:40:32.241064 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 01:40:32.360471 tst mo_mt_sms.py:9: start nitb and bts... 01:40:32.558580 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:40:33.165224 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9906): Launched 01:40:33.462459 run osmo-nitb_10.42.42.2(pid=9907): Launched 01:40:33.628024 run osmo-nitb_10.42.42.2(pid=9907): ERR: Terminated: ERROR {rc=2} [trial-2367↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9907)] 01:40:33.761779 run osmo-nitb_10.42.42.2(pid=9907): stdout: | (launched: 2022-12-10_01:40:33.407431) 01:40:33.896594 run osmo-nitb_10.42.42.2(pid=9907): stderr: | (launched: 2022-12-10_01:40:33.451588) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:40:34.031477 run osmo-nitb_10.42.42.2(pid=9907): stdout: | (launched: 2022-12-10_01:40:33.407431) 01:40:34.160693 run osmo-nitb_10.42.42.2(pid=9907): stderr: | (launched: 2022-12-10_01:40:33.451588) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9907): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9907) [trial-2367↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9907)] 01:40:34.575213 tst osmo-nitb_10.42.42.2(pid=9907): stdout: | (launched: 2022-12-10_01:40:33.407431) 01:40:34.696474 tst osmo-nitb_10.42.42.2(pid=9907): stderr: | (launched: 2022-12-10_01:40:33.451588) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:40:34.838401 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=9907): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9907) [trial-2367↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9907)] [trial-2367↪nitb_sms:nanobts↪mo_mt_sms.py:11] 01:40:34.846774 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 01:40:34.853372 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9906): Terminating (SIGTERM) 01:40:35.064158 --- ParallelTerminationStrategy: PID 9906 died... 01:40:35.084652 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9906): Terminated: ok {rc=0} 01:40:35.169086 bus /sierra_3: Setting Powered False 01:40:36.270938 bus /sierra_3: Setting Powered False 01:40:37.391155 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 sms:nanobts+band-1900 --------------------------------------------------------------------- 01:40:38.575530 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:40:38.580446 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 01:40:38.604241 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 01:40:38.632163 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 01:40:38.683982 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 01:40:38.707616 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 01:40:38.733805 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 01:40:39.281796 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 01:40:39.286657 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:40:39.297358 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 01:40:39.335777 tst mo_mt_sms.py: using LAC 25102 01:40:39.451422 tst mo_mt_sms.py: using RAC 112 01:40:39.578770 tst mo_mt_sms.py: using CellId 25102 01:40:39.704824 tst mo_mt_sms.py: using BVCI 25103 01:40:39.819958 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:40:39.831293 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:40:39.842580 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:40:39.853548 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:40:39.864495 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:40:39.875400 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 01:40:39.989600 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 01:40:40.103195 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:40:40.566344 run create_hlr_db(pid=9913): Launched 01:40:40.683549 bus /sierra_2: Setting Powered False 01:40:41.740729 run create_hlr_db(pid=9913): Terminated: ok {rc=0} 01:40:42.175832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9915): Launched 01:40:42.495103 run osmo-hlr_10.42.42.2(pid=9916): Launched 01:40:42.619005 run osmo-stp_10.42.42.5: Starting osmo-stp 01:40:43.170609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9918): Launched 01:40:43.489367 run osmo-stp_10.42.42.5(pid=9919): Launched 01:40:43.612366 run osmo-msc_10.42.42.6: Starting osmo-msc 01:40:44.186949 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9921): Launched 01:40:44.507649 run osmo-msc_10.42.42.6(pid=9922): Launched 01:40:44.686951 run osmo-stp_10.42.42.5(pid=9919): ERR: Terminated: ERROR {rc=1} [trial-2367↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9919)] 01:40:44.822330 run osmo-stp_10.42.42.5(pid=9919): stdout: | (launched: 2022-12-10_01:40:43.431046) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:40:44.956412 run osmo-stp_10.42.42.5(pid=9919): stderr: | 20221210014043624 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014043624 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014043624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014043625 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014043625 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014043625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014043625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:40:45.089604 run osmo-stp_10.42.42.5(pid=9919): stdout: | (launched: 2022-12-10_01:40:43.431046) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:40:45.215926 run osmo-stp_10.42.42.5(pid=9919): stderr: | 20221210014043624 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014043624 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014043624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014043625 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014043625 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014043625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014043625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:40:45.367708 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=9919): Process ended prematurely: osmo-stp_10.42.42.5(pid=9919) [trial-2367↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9919)] [trial-2367↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 01:40:45.376621 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 01:40:45.404006 run osmo-hlr_10.42.42.2(pid=9916): ERR: Terminated: ERROR {rc=237} [trial-2367↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9916)] 01:40:45.453980 run osmo-hlr_10.42.42.2(pid=9916): stdout: | (launched: 2022-12-10_01:40:42.436689) 01:40:45.505502 run osmo-hlr_10.42.42.2(pid=9916): stderr: | 20221210014042636 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014042636 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014042636 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014042636 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014042636 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014042636 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014042649 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014042657 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014042657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014042658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:40:45.577287 run osmo-msc_10.42.42.6(pid=9922): ERR: Terminated: ERROR {rc=2} [trial-2367↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9922)] 01:40:45.627048 run osmo-msc_10.42.42.6(pid=9922): stdout: | (launched: 2022-12-10_01:40:44.449049) 01:40:45.678298 run osmo-msc_10.42.42.6(pid=9922): stderr: | 20221210014044771 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210014044771 DLGLOBAL DEBUG validating counter group 0x7faafe02bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210014044771 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210014044771 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210014044772 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210014044772 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210014044773 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210014044774 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210014044774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210014044774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:40:45.730196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9915): Terminating (SIGTERM) 01:40:45.771780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9918): Terminating (SIGTERM) 01:40:45.813355 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9921): Terminating (SIGTERM) 01:40:45.870525 --- ParallelTerminationStrategy: PID 9915 died... 01:40:45.891493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9915): Terminated: ok {rc=0} 01:40:45.957256 --- ParallelTerminationStrategy: PID 9918 died... 01:40:45.977380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9918): Terminated: ok {rc=0} 01:40:46.024457 --- ParallelTerminationStrategy: PID 9921 died... 01:40:46.045486 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9921): Terminated: ok {rc=0} 01:40:46.135399 bus /sierra_3: Setting Powered False 01:40:47.235142 bus /sierra_3: Setting Powered False 01:40:48.352613 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 01:40:49.576679 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:40:49.581371 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 01:40:49.605380 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 01:40:49.612761 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 01:40:49.648258 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 01:40:49.672713 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 01:40:49.679882 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 01:40:50.198270 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2367 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 01:40:50.203157 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 01:40:50.214065 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 01:40:50.251728 tst assert_extension.py: using LAC 25103 01:40:50.367148 tst assert_extension.py: using RAC 113 01:40:50.485387 tst assert_extension.py: using CellId 25103 01:40:50.611745 tst assert_extension.py: using BVCI 25104 01:40:50.726871 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 01:40:50.841957 tst assert_extension.py:10: start nitb and bts... 01:40:51.040245 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:40:51.647382 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9927): Launched 01:40:51.945634 run osmo-nitb_10.42.42.2(pid=9928): Launched 01:40:52.112054 run osmo-nitb_10.42.42.2(pid=9928): ERR: Terminated: ERROR {rc=2} [trial-2367↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9928)] 01:40:52.245875 run osmo-nitb_10.42.42.2(pid=9928): stdout: | (launched: 2022-12-10_01:40:51.889856) 01:40:52.380677 run osmo-nitb_10.42.42.2(pid=9928): stderr: | (launched: 2022-12-10_01:40:51.934059) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:40:52.515691 run osmo-nitb_10.42.42.2(pid=9928): stdout: | (launched: 2022-12-10_01:40:51.889856) 01:40:52.645280 run osmo-nitb_10.42.42.2(pid=9928): stderr: | (launched: 2022-12-10_01:40:51.934059) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9928): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9928) [trial-2367↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9928)] 01:40:53.058997 tst osmo-nitb_10.42.42.2(pid=9928): stdout: | (launched: 2022-12-10_01:40:51.889856) 01:40:53.178925 tst osmo-nitb_10.42.42.2(pid=9928): stderr: | (launched: 2022-12-10_01:40:51.934059) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:40:53.320799 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=9928): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9928) [trial-2367↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9928)] [trial-2367↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 01:40:53.329263 tst assert_extension.py:12: Test FAILED (3.1 sec) 01:40:53.335911 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9927): Terminating (SIGTERM) 01:40:53.544771 --- ParallelTerminationStrategy: PID 9927 died... 01:40:53.565040 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9927): Terminated: ok {rc=0} 01:40:53.649835 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 ussd:nanobts+band-1900 --------------------------------------------------------------------- 01:40:54.819092 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:40:54.824439 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 01:40:54.849659 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 01:40:54.877440 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 01:40:54.913686 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 01:40:54.939258 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 01:40:54.967274 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 01:40:55.495527 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2367 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 01:40:55.501031 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:40:55.512245 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 01:40:55.551965 tst assert_extension.py: using LAC 25104 01:40:55.676052 tst assert_extension.py: using RAC 114 01:40:55.794911 tst assert_extension.py: using CellId 25104 01:40:55.911932 tst assert_extension.py: using BVCI 25105 01:40:56.021503 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:40:56.032160 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:40:56.042726 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:40:56.054092 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:40:56.065580 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:40:56.076715 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 01:40:56.195194 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:40:56.688580 run create_hlr_db(pid=9932): Launched 01:40:56.818442 bus /sierra_2: Setting Powered False 01:40:57.881791 run create_hlr_db(pid=9932): Terminated: ok {rc=0} 01:40:58.325566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9934): Launched 01:40:58.647003 run osmo-hlr_10.42.42.2(pid=9935): Launched 01:40:58.769831 run osmo-stp_10.42.42.5: Starting osmo-stp 01:40:59.319668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9937): Launched 01:40:59.639442 run osmo-stp_10.42.42.5(pid=9938): Launched 01:40:59.760618 run osmo-msc_10.42.42.6: Starting osmo-msc 01:41:00.335134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9940): Launched 01:41:00.654531 run osmo-msc_10.42.42.6(pid=9941): Launched 01:41:00.843347 run osmo-stp_10.42.42.5(pid=9938): ERR: Terminated: ERROR {rc=1} [trial-2367↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9938)] 01:41:01.175113 run osmo-stp_10.42.42.5(pid=9938): stdout: | (launched: 2022-12-10_01:40:59.580363) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:41:01.543735 run osmo-stp_10.42.42.5(pid=9938): stderr: | 20221210014059774 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014059775 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014059775 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014059775 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014059776 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014059776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014059776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:41:01.680934 run osmo-stp_10.42.42.5(pid=9938): stdout: | (launched: 2022-12-10_01:40:59.580363) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:41:01.804215 run osmo-stp_10.42.42.5(pid=9938): stderr: | 20221210014059774 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014059775 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014059775 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014059775 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014059776 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014059776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014059776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:41:01.951225 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=9938): Process ended prematurely: osmo-stp_10.42.42.5(pid=9938) [trial-2367↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9938)] [trial-2367↪ussd:nanobts+band-1900↪assert_extension.py:17] 01:41:01.960451 tst assert_extension.py:17: Test FAILED (6.5 sec) 01:41:01.989091 run osmo-hlr_10.42.42.2(pid=9935): ERR: Terminated: ERROR {rc=237} [trial-2367↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9935)] 01:41:02.039228 run osmo-hlr_10.42.42.2(pid=9935): stdout: | (launched: 2022-12-10_01:40:58.588240) 01:41:02.091286 run osmo-hlr_10.42.42.2(pid=9935): stderr: | 20221210014058787 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014058787 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014058787 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014058787 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014058787 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014058787 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014058832 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014058841 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014058841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014058841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:41:02.164833 run osmo-msc_10.42.42.6(pid=9941): ERR: Terminated: ERROR {rc=2} [trial-2367↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9941)] 01:41:02.214291 run osmo-msc_10.42.42.6(pid=9941): stdout: | (launched: 2022-12-10_01:41:00.595906) 01:41:02.265400 run osmo-msc_10.42.42.6(pid=9941): stderr: | 20221210014101033 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210014101033 DLGLOBAL DEBUG validating counter group 0x7fb60e4cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210014101033 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210014101033 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210014101033 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210014101033 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210014101035 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210014101036 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210014101036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210014101036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:41:02.317249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9934): Terminating (SIGTERM) 01:41:02.357352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9937): Terminating (SIGTERM) 01:41:02.397509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9940): Terminating (SIGTERM) 01:41:02.437628 --- ParallelTerminationStrategy: PID 9934 died... 01:41:02.456820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9934): Terminated: ok {rc=0} 01:41:02.501104 --- ParallelTerminationStrategy: PID 9937 died... 01:41:02.519658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9937): Terminated: ok {rc=0} 01:41:02.564009 --- ParallelTerminationStrategy: PID 9940 died... 01:41:02.582612 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9940): Terminated: ok {rc=0} 01:41:02.667343 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 01:41:03.869967 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:41:03.878588 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 01:41:03.905719 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 01:41:03.933636 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 01:41:03.988306 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 01:41:04.013063 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 01:41:04.041050 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 01:41:04.595111 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 01:41:04.650502 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:41:04.662159 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:41:04.722670 tst mo_mt_call.py: using LAC 25105 01:41:04.848538 tst mo_mt_call.py: using RAC 115 01:41:04.973830 tst mo_mt_call.py: using CellId 25105 01:41:05.099035 tst mo_mt_call.py: using BVCI 25106 01:41:05.215966 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:41:05.227666 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:41:05.239168 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:41:05.251104 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:41:05.263607 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:41:05.275549 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:41:05.392934 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:41:05.510908 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:41:05.978673 run create_hlr_db(pid=9946): Launched 01:41:06.096240 bus /sierra_2: Setting Powered False 01:41:07.157624 run create_hlr_db(pid=9946): Terminated: ok {rc=0} 01:41:07.598905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9948): Launched 01:41:07.922449 run osmo-hlr_10.42.42.2(pid=9949): Launched 01:41:08.047335 run osmo-stp_10.42.42.5: Starting osmo-stp 01:41:08.605436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9951): Launched 01:41:08.928366 run osmo-stp_10.42.42.5(pid=9952): Launched 01:41:09.053411 run osmo-msc_10.42.42.6: Starting osmo-msc 01:41:09.638295 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9954): Launched 01:41:09.961584 run osmo-msc_10.42.42.6(pid=9955): Launched 01:41:10.143527 run osmo-stp_10.42.42.5(pid=9952): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9952)] 01:41:10.279592 run osmo-stp_10.42.42.5(pid=9952): stdout: | (launched: 2022-12-10_01:41:08.869575) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:41:10.415721 run osmo-stp_10.42.42.5(pid=9952): stderr: | 20221210014109065 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014109065 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014109065 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014109065 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014109066 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014109066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014109066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:41:10.551200 run osmo-stp_10.42.42.5(pid=9952): stdout: | (launched: 2022-12-10_01:41:08.869575) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:41:10.679755 run osmo-stp_10.42.42.5(pid=9952): stderr: | 20221210014109065 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014109065 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014109065 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014109065 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014109066 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014109066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014109066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:41:10.833989 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9952): Process ended prematurely: osmo-stp_10.42.42.5(pid=9952) [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9952)] [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 01:41:10.843674 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 01:41:10.871968 run osmo-hlr_10.42.42.2(pid=9949): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9949)] 01:41:10.922013 run osmo-hlr_10.42.42.2(pid=9949): stdout: | (launched: 2022-12-10_01:41:07.863270) 01:41:10.974055 run osmo-hlr_10.42.42.2(pid=9949): stderr: | 20221210014108062 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014108062 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014108062 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014108062 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014108062 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014108062 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014108074 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014108083 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014108083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014108083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:41:11.046518 run osmo-msc_10.42.42.6(pid=9955): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9955)] 01:41:11.096686 run osmo-msc_10.42.42.6(pid=9955): stdout: | (launched: 2022-12-10_01:41:09.902206) 01:41:11.148176 run osmo-msc_10.42.42.6(pid=9955): stderr: | 20221210014110225 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210014110225 DLGLOBAL DEBUG validating counter group 0x7f30e8962c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210014110225 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210014110225 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210014110226 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210014110226 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210014110227 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210014110228 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210014110228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210014110228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:41:11.199910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9948): Terminating (SIGTERM) 01:41:11.241435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9951): Terminating (SIGTERM) 01:41:11.283559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9954): Terminating (SIGTERM) 01:41:11.326068 --- ParallelTerminationStrategy: PID 9948 died... 01:41:11.345791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9948): Terminated: ok {rc=0} 01:41:11.392033 --- ParallelTerminationStrategy: PID 9951 died... 01:41:11.411625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9951): Terminated: ok {rc=0} 01:41:11.457725 --- ParallelTerminationStrategy: PID 9954 died... 01:41:11.477382 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9954): Terminated: ok {rc=0} 01:41:11.565254 bus /sierra_3: Setting Powered False 01:41:12.664790 bus /sierra_3: Setting Powered False 01:41:13.783368 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 01:41:14.928685 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:41:14.940893 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:41:15.001875 tst mo_mt_call_osmux.py: using LAC 25106 01:41:15.123069 tst mo_mt_call_osmux.py: using RAC 116 01:41:15.243012 tst mo_mt_call_osmux.py: using CellId 25106 01:41:15.362022 tst mo_mt_call_osmux.py: using BVCI 25107 01:41:15.471102 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:41:15.482423 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:41:15.493774 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:41:15.505318 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:41:15.516673 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:41:15.528132 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:41:15.645577 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:41:15.763466 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:41:16.264577 run create_hlr_db(pid=9958): Launched 01:41:16.386939 bus /sierra_2: Setting Powered False 01:41:17.447410 run create_hlr_db(pid=9958): Terminated: ok {rc=0} 01:41:17.888062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9960): Launched 01:41:18.212247 run osmo-hlr_10.42.42.2(pid=9961): Launched 01:41:18.336735 run osmo-stp_10.42.42.5: Starting osmo-stp 01:41:18.894138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9963): Launched 01:41:19.218548 run osmo-stp_10.42.42.5(pid=9964): Launched 01:41:19.344844 run osmo-msc_10.42.42.6: Starting osmo-msc 01:41:19.929843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9966): Launched 01:41:20.254918 run osmo-msc_10.42.42.6(pid=9967): Launched 01:41:20.437642 run osmo-stp_10.42.42.5(pid=9964): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9964)] 01:41:20.572534 run osmo-stp_10.42.42.5(pid=9964): stdout: | (launched: 2022-12-10_01:41:19.159162) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:41:20.707825 run osmo-stp_10.42.42.5(pid=9964): stderr: | 20221210014119353 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014119353 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014119353 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014119354 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014119354 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014119354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014119354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:41:20.843059 run osmo-stp_10.42.42.5(pid=9964): stdout: | (launched: 2022-12-10_01:41:19.159162) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:41:20.971467 run osmo-stp_10.42.42.5(pid=9964): stderr: | 20221210014119353 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014119353 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014119353 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014119354 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014119354 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014119354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014119354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:41:21.125767 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9964): Process ended prematurely: osmo-stp_10.42.42.5(pid=9964) [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9964)] [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 01:41:21.135638 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 01:41:21.163982 run osmo-hlr_10.42.42.2(pid=9961): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9961)] 01:41:21.214258 run osmo-hlr_10.42.42.2(pid=9961): stdout: | (launched: 2022-12-10_01:41:18.153056) 01:41:21.266351 run osmo-hlr_10.42.42.2(pid=9961): stderr: | 20221210014118351 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014118351 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014118351 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014118351 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014118351 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014118351 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014118396 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014118405 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014118406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014118406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:41:21.338800 run osmo-msc_10.42.42.6(pid=9967): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9967)] 01:41:21.389139 run osmo-msc_10.42.42.6(pid=9967): stdout: | (launched: 2022-12-10_01:41:20.195337) 01:41:21.440586 run osmo-msc_10.42.42.6(pid=9967): stderr: | 20221210014120518 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210014120518 DLGLOBAL DEBUG validating counter group 0x7f71e1124c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210014120518 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210014120518 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210014120519 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210014120519 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210014120520 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210014120521 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210014120521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210014120521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:41:21.492382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9960): Terminating (SIGTERM) 01:41:21.534198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9963): Terminating (SIGTERM) 01:41:21.575906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9966): Terminating (SIGTERM) 01:41:21.618078 --- ParallelTerminationStrategy: PID 9960 died... 01:41:21.638146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9960): Terminated: ok {rc=0} 01:41:21.684381 --- ParallelTerminationStrategy: PID 9963 died... 01:41:21.703984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9963): Terminated: ok {rc=0} 01:41:21.749915 --- ParallelTerminationStrategy: PID 9966 died... 01:41:21.769597 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9966): Terminated: ok {rc=0} 01:41:21.857313 bus /sierra_3: Setting Powered False 01:41:22.953750 bus /sierra_3: Setting Powered False 01:41:24.070046 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 01:41:25.321844 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:41:25.329242 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 01:41:25.353473 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 01:41:25.379962 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 01:41:25.430230 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 01:41:25.453644 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 01:41:25.479751 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 01:41:26.034789 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 01:41:26.083316 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:41:26.094572 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:41:26.151843 tst mo_mt_call.py: using LAC 25107 01:41:26.269855 tst mo_mt_call.py: using RAC 117 01:41:26.387342 tst mo_mt_call.py: using CellId 25107 01:41:26.503380 tst mo_mt_call.py: using BVCI 25108 01:41:26.612326 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:41:26.623553 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:41:26.634546 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:41:26.645868 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:41:26.657270 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:41:26.668351 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:41:26.786468 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:41:26.901736 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:41:27.370196 run create_hlr_db(pid=9972): Launched 01:41:27.485506 bus /sierra_2: Setting Powered False 01:41:28.545720 run create_hlr_db(pid=9972): Terminated: ok {rc=0} 01:41:28.986298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9974): Launched 01:41:29.310439 run osmo-hlr_10.42.42.2(pid=9975): Launched 01:41:29.434394 run osmo-stp_10.42.42.5: Starting osmo-stp 01:41:29.991792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9977): Launched 01:41:30.316417 run osmo-stp_10.42.42.5(pid=9978): Launched 01:41:30.440286 run osmo-msc_10.42.42.6: Starting osmo-msc 01:41:31.027411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9980): Launched 01:41:31.349642 run osmo-msc_10.42.42.6(pid=9981): Launched 01:41:31.789605 run osmo-stp_10.42.42.5(pid=9978): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9978)] 01:41:31.925389 run osmo-stp_10.42.42.5(pid=9978): stdout: | (launched: 2022-12-10_01:41:30.256375) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:41:32.061485 run osmo-stp_10.42.42.5(pid=9978): stderr: | 20221210014130449 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014130449 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014130450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014130450 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014130450 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014130451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014130451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:41:32.198038 run osmo-stp_10.42.42.5(pid=9978): stdout: | (launched: 2022-12-10_01:41:30.256375) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:41:32.329845 run osmo-stp_10.42.42.5(pid=9978): stderr: | 20221210014130449 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014130449 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014130450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014130450 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014130450 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014130451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014130451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:41:32.484781 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9978): Process ended prematurely: osmo-stp_10.42.42.5(pid=9978) [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9978)] [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 01:41:32.494677 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 01:41:32.523085 run osmo-hlr_10.42.42.2(pid=9975): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9975)] 01:41:32.573360 run osmo-hlr_10.42.42.2(pid=9975): stdout: | (launched: 2022-12-10_01:41:29.250674) 01:41:32.625363 run osmo-hlr_10.42.42.2(pid=9975): stderr: | 20221210014129449 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014129449 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014129449 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014129449 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014129449 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014129449 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014129482 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014129492 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014129492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014129493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:41:32.697854 run osmo-msc_10.42.42.6(pid=9981): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9981)] 01:41:32.747939 run osmo-msc_10.42.42.6(pid=9981): stdout: | (launched: 2022-12-10_01:41:31.287302) 01:41:32.799862 run osmo-msc_10.42.42.6(pid=9981): stderr: | 20221210014131592 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210014131592 DLGLOBAL DEBUG validating counter group 0x7f3acc474c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210014131592 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210014131592 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210014131592 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210014131592 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210014131594 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210014131595 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210014131595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210014131595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:41:32.851919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9974): Terminating (SIGTERM) 01:41:32.893876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9977): Terminating (SIGTERM) 01:41:32.935775 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9980): Terminating (SIGTERM) 01:41:32.977801 --- ParallelTerminationStrategy: PID 9974 died... 01:41:32.997814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9974): Terminated: ok {rc=0} 01:41:33.044333 --- ParallelTerminationStrategy: PID 9977 died... 01:41:33.064001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9977): Terminated: ok {rc=0} 01:41:33.110161 --- ParallelTerminationStrategy: PID 9980 died... 01:41:33.129728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9980): Terminated: ok {rc=0} 01:41:33.216998 bus /sierra_3: Setting Powered False 01:41:34.315174 bus /sierra_3: Setting Powered False 01:41:35.429990 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 01:41:36.579046 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:41:36.591587 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:41:36.653787 tst mo_mt_call_osmux.py: using LAC 25108 01:41:36.781667 tst mo_mt_call_osmux.py: using RAC 118 01:41:36.907680 tst mo_mt_call_osmux.py: using CellId 25108 01:41:37.034455 tst mo_mt_call_osmux.py: using BVCI 25109 01:41:37.153440 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:41:37.165345 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:41:37.177129 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:41:37.188877 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:41:37.200779 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:41:37.212513 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:41:37.329157 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:41:37.450535 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:41:37.951325 run create_hlr_db(pid=9983): Launched 01:41:38.080023 bus /sierra_2: Setting Powered False 01:41:39.140811 run create_hlr_db(pid=9983): Terminated: ok {rc=0} 01:41:39.581768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9985): Launched 01:41:39.905952 run osmo-hlr_10.42.42.2(pid=9986): Launched 01:41:40.030581 run osmo-stp_10.42.42.5: Starting osmo-stp 01:41:40.586878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9988): Launched 01:41:40.910116 run osmo-stp_10.42.42.5(pid=9989): Launched 01:41:41.034640 run osmo-msc_10.42.42.6: Starting osmo-msc 01:41:41.619314 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9991): Launched 01:41:41.945502 run osmo-msc_10.42.42.6(pid=9992): Launched 01:41:42.126522 run osmo-stp_10.42.42.5(pid=9989): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9989)] 01:41:42.262968 run osmo-stp_10.42.42.5(pid=9989): stdout: | (launched: 2022-12-10_01:41:40.851034) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:41:42.400513 run osmo-stp_10.42.42.5(pid=9989): stderr: | 20221210014141043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014141044 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014141044 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014141044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014141046 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014141047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014141047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:41:42.535866 run osmo-stp_10.42.42.5(pid=9989): stdout: | (launched: 2022-12-10_01:41:40.851034) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:41:42.665077 run osmo-stp_10.42.42.5(pid=9989): stderr: | 20221210014141043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014141044 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014141044 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014141044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014141046 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014141047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014141047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:41:42.819422 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9989): Process ended prematurely: osmo-stp_10.42.42.5(pid=9989) [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9989)] [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 01:41:42.829269 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 01:41:42.857041 run osmo-hlr_10.42.42.2(pid=9986): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9986)] 01:41:42.906715 run osmo-hlr_10.42.42.2(pid=9986): stdout: | (launched: 2022-12-10_01:41:39.846065) 01:41:42.957920 run osmo-hlr_10.42.42.2(pid=9986): stderr: | 20221210014140046 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014140046 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014140046 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014140046 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014140046 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014140046 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014140059 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014140067 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014140067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014140067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:41:43.029160 run osmo-msc_10.42.42.6(pid=9992): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9992)] 01:41:43.078534 run osmo-msc_10.42.42.6(pid=9992): stdout: | (launched: 2022-12-10_01:41:41.885629) 01:41:43.129665 run osmo-msc_10.42.42.6(pid=9992): stderr: | 20221210014142209 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210014142209 DLGLOBAL DEBUG validating counter group 0x7f1f2a558c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210014142209 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210014142209 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210014142209 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210014142209 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210014142211 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210014142211 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210014142212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210014142212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:41:43.181403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9985): Terminating (SIGTERM) 01:41:43.223036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9988): Terminating (SIGTERM) 01:41:43.264645 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9991): Terminating (SIGTERM) 01:41:43.306854 --- ParallelTerminationStrategy: PID 9985 died... 01:41:43.326909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9985): Terminated: ok {rc=0} 01:41:43.372922 --- ParallelTerminationStrategy: PID 9988 died... 01:41:43.392553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9988): Terminated: ok {rc=0} 01:41:43.438248 --- ParallelTerminationStrategy: PID 9991 died... 01:41:43.457883 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9991): Terminated: ok {rc=0} 01:41:43.545468 bus /sierra_3: Setting Powered False 01:41:44.644363 bus /sierra_3: Setting Powered False 01:41:45.761789 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 01:41:47.028693 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:41:47.036823 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 01:41:47.067666 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 01:41:47.102911 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 01:41:47.164094 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 01:41:47.200472 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 01:41:47.229876 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 01:41:47.766731 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 01:41:47.816406 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:41:47.827889 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:41:47.887171 tst mo_mt_call.py: using LAC 25109 01:41:48.007382 tst mo_mt_call.py: using RAC 119 01:41:48.126702 tst mo_mt_call.py: using CellId 25109 01:41:48.246038 tst mo_mt_call.py: using BVCI 25110 01:41:48.357483 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:41:48.368728 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:41:48.379762 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:41:48.391050 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:41:48.402396 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:41:48.413779 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:41:48.531569 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:41:48.647041 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:41:49.115459 run create_hlr_db(pid=9997): Launched 01:41:49.230821 bus /sierra_2: Setting Powered False 01:41:50.291835 run create_hlr_db(pid=9997): Terminated: ok {rc=0} 01:41:50.732757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9999): Launched 01:41:51.054640 run osmo-hlr_10.42.42.2(pid=10000): Launched 01:41:51.179692 run osmo-stp_10.42.42.5: Starting osmo-stp 01:41:51.734800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10002): Launched 01:41:52.056419 run osmo-stp_10.42.42.5(pid=10003): Launched 01:41:52.180153 run osmo-msc_10.42.42.6: Starting osmo-msc 01:41:52.767273 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10005): Launched 01:41:53.090612 run osmo-msc_10.42.42.6(pid=10006): Launched 01:41:53.271918 run osmo-stp_10.42.42.5(pid=10003): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10003)] 01:41:53.408817 run osmo-stp_10.42.42.5(pid=10003): stdout: | (launched: 2022-12-10_01:41:51.997380) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:41:53.544459 run osmo-stp_10.42.42.5(pid=10003): stderr: | 20221210014152190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014152190 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014152190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014152191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014152191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014152191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014152191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:41:53.679617 run osmo-stp_10.42.42.5(pid=10003): stdout: | (launched: 2022-12-10_01:41:51.997380) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:41:53.808253 run osmo-stp_10.42.42.5(pid=10003): stderr: | 20221210014152190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014152190 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014152190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014152191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014152191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014152191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014152191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:41:53.962233 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10003): Process ended prematurely: osmo-stp_10.42.42.5(pid=10003) [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10003)] [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 01:41:53.971851 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 01:41:53.999666 run osmo-hlr_10.42.42.2(pid=10000): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10000)] 01:41:54.049338 run osmo-hlr_10.42.42.2(pid=10000): stdout: | (launched: 2022-12-10_01:41:50.995737) 01:41:54.100923 run osmo-hlr_10.42.42.2(pid=10000): stderr: | 20221210014151196 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014151196 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014151196 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014151196 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014151196 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014151196 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014151208 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014151216 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014151217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014151217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:41:54.172703 run osmo-msc_10.42.42.6(pid=10006): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10006)] 01:41:54.222283 run osmo-msc_10.42.42.6(pid=10006): stdout: | (launched: 2022-12-10_01:41:53.031318) 01:41:54.273245 run osmo-msc_10.42.42.6(pid=10006): stderr: | 20221210014153355 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210014153355 DLGLOBAL DEBUG validating counter group 0x7f3b5ae0bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210014153355 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210014153355 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210014153355 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210014153355 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210014153357 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210014153357 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210014153357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210014153358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:41:54.325384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9999): Terminating (SIGTERM) 01:41:54.366792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10002): Terminating (SIGTERM) 01:41:54.408132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10005): Terminating (SIGTERM) 01:41:54.450148 --- ParallelTerminationStrategy: PID 9999 died... 01:41:54.470098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9999): Terminated: ok {rc=0} 01:41:54.515915 --- ParallelTerminationStrategy: PID 10002 died... 01:41:54.535391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10002): Terminated: ok {rc=0} 01:41:54.580698 --- ParallelTerminationStrategy: PID 10005 died... 01:41:54.600190 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10005): Terminated: ok {rc=0} 01:41:54.686746 bus /sierra_3: Setting Powered False 01:41:55.785674 bus /sierra_3: Setting Powered False 01:41:56.900724 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 01:41:58.049205 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:41:58.061820 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:41:58.124492 tst mo_mt_call_osmux.py: using LAC 25110 01:41:58.251010 tst mo_mt_call_osmux.py: using RAC 120 01:41:58.379752 tst mo_mt_call_osmux.py: using CellId 25110 01:41:58.505778 tst mo_mt_call_osmux.py: using BVCI 25111 01:41:58.622831 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:41:58.634880 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:41:58.646496 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:41:58.658572 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:41:58.670665 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:41:58.682616 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:41:58.802825 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:41:58.920381 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:41:59.390352 run create_hlr_db(pid=10008): Launched 01:41:59.506968 bus /sierra_2: Setting Powered False 01:42:00.571461 run create_hlr_db(pid=10008): Terminated: ok {rc=0} 01:42:01.131567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10019): Launched 01:42:01.471876 run osmo-hlr_10.42.42.2(pid=10020): Launched 01:42:01.658907 run osmo-stp_10.42.42.5: Starting osmo-stp 01:42:02.372147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10022): Launched 01:42:02.703837 run osmo-stp_10.42.42.5(pid=10023): Launched 01:42:02.828906 run osmo-msc_10.42.42.6: Starting osmo-msc 01:42:03.420879 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10025): Launched 01:42:03.744915 run osmo-msc_10.42.42.6(pid=10026): Launched 01:42:03.927246 run osmo-stp_10.42.42.5(pid=10023): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10023)] 01:42:04.063174 run osmo-stp_10.42.42.5(pid=10023): stdout: | (launched: 2022-12-10_01:42:02.644242) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:42:04.199500 run osmo-stp_10.42.42.5(pid=10023): stderr: | 20221210014202838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014202839 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014202839 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014202839 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014202840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014202840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014202840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:42:04.335089 run osmo-stp_10.42.42.5(pid=10023): stdout: | (launched: 2022-12-10_01:42:02.644242) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:42:04.463941 run osmo-stp_10.42.42.5(pid=10023): stderr: | 20221210014202838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014202839 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014202839 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014202839 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014202840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014202840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014202840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:42:04.618421 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10023): Process ended prematurely: osmo-stp_10.42.42.5(pid=10023) [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10023)] [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 01:42:04.628253 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 01:42:04.656208 run osmo-hlr_10.42.42.2(pid=10020): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10020)] 01:42:04.706186 run osmo-hlr_10.42.42.2(pid=10020): stdout: | (launched: 2022-12-10_01:42:01.411902) 01:42:04.757619 run osmo-hlr_10.42.42.2(pid=10020): stderr: | 20221210014201768 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014201768 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014201768 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014201768 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014201769 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014201769 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014201792 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014201808 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014201808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014201808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:42:04.829590 run osmo-msc_10.42.42.6(pid=10026): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10026)] 01:42:04.879228 run osmo-msc_10.42.42.6(pid=10026): stdout: | (launched: 2022-12-10_01:42:03.685521) 01:42:04.930412 run osmo-msc_10.42.42.6(pid=10026): stderr: | 20221210014204007 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210014204007 DLGLOBAL DEBUG validating counter group 0x7f664a67dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210014204007 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210014204007 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210014204007 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210014204008 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210014204011 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210014204011 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210014204012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210014204012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:42:04.981996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10019): Terminating (SIGTERM) 01:42:05.023290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10022): Terminating (SIGTERM) 01:42:05.064797 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10025): Terminating (SIGTERM) 01:42:05.106736 --- ParallelTerminationStrategy: PID 10019 died... 01:42:05.126607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10019): Terminated: ok {rc=0} 01:42:05.172770 --- ParallelTerminationStrategy: PID 10022 died... 01:42:05.192683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10022): Terminated: ok {rc=0} 01:42:05.238279 --- ParallelTerminationStrategy: PID 10025 died... 01:42:05.257804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10025): Terminated: ok {rc=0} 01:42:05.345725 bus /sierra_3: Setting Powered False 01:42:06.444865 bus /sierra_3: Setting Powered False 01:42:07.559261 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 01:42:08.804426 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:42:08.812518 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 01:42:08.837086 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 01:42:08.863985 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 01:42:08.922858 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 01:42:08.947388 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 01:42:08.974436 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 01:42:09.528248 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 01:42:09.581762 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:42:09.593421 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:42:09.661260 tst mo_mt_call.py: using LAC 25111 01:42:09.787916 tst mo_mt_call.py: using RAC 121 01:42:09.916604 tst mo_mt_call.py: using CellId 25111 01:42:10.042215 tst mo_mt_call.py: using BVCI 25112 01:42:10.158357 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:42:10.170061 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:42:10.181617 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:42:10.193121 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:42:10.204736 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:42:10.216428 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:42:10.332773 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:42:10.449099 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:42:10.915623 run create_hlr_db(pid=10031): Launched 01:42:11.034137 bus /sierra_2: Setting Powered False 01:42:12.094498 run create_hlr_db(pid=10031): Terminated: ok {rc=0} 01:42:12.534854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10033): Launched 01:42:12.858211 run osmo-hlr_10.42.42.2(pid=10034): Launched 01:42:12.981514 run osmo-stp_10.42.42.5: Starting osmo-stp 01:42:13.537692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10036): Launched 01:42:13.862861 run osmo-stp_10.42.42.5(pid=10037): Launched 01:42:13.987032 run osmo-msc_10.42.42.6: Starting osmo-msc 01:42:14.569309 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10039): Launched 01:42:14.894021 run osmo-msc_10.42.42.6(pid=10040): Launched 01:42:15.075185 run osmo-stp_10.42.42.5(pid=10037): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10037)] 01:42:15.210506 run osmo-stp_10.42.42.5(pid=10037): stdout: | (launched: 2022-12-10_01:42:13.803243) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:42:15.346762 run osmo-stp_10.42.42.5(pid=10037): stderr: | 20221210014213996 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014213996 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014213996 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014213997 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014213997 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014213997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014213998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:42:15.481574 run osmo-stp_10.42.42.5(pid=10037): stdout: | (launched: 2022-12-10_01:42:13.803243) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:42:15.609655 run osmo-stp_10.42.42.5(pid=10037): stderr: | 20221210014213996 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014213996 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014213996 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014213997 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014213997 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014213997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014213998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:42:15.762995 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10037): Process ended prematurely: osmo-stp_10.42.42.5(pid=10037) [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10037)] [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 01:42:15.772372 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 01:42:15.800097 run osmo-hlr_10.42.42.2(pid=10034): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10034)] 01:42:15.851768 run osmo-hlr_10.42.42.2(pid=10034): stdout: | (launched: 2022-12-10_01:42:12.798883) 01:42:15.907001 run osmo-hlr_10.42.42.2(pid=10034): stderr: | 20221210014212998 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014212998 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014212998 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014212998 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014212998 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014212998 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014213011 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014213019 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014213019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014213019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:42:15.982409 run osmo-msc_10.42.42.6(pid=10040): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10040)] 01:42:16.033441 run osmo-msc_10.42.42.6(pid=10040): stdout: | (launched: 2022-12-10_01:42:14.834733) 01:42:16.085755 run osmo-msc_10.42.42.6(pid=10040): stderr: | 20221210014215157 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210014215157 DLGLOBAL DEBUG validating counter group 0x7f6cb5c1bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210014215158 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210014215158 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210014215158 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210014215158 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210014215160 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210014215160 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210014215160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210014215160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:42:16.139631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10033): Terminating (SIGTERM) 01:42:16.181607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10036): Terminating (SIGTERM) 01:42:16.223861 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10039): Terminating (SIGTERM) 01:42:16.267223 --- ParallelTerminationStrategy: PID 10033 died... 01:42:16.287432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10033): Terminated: ok {rc=0} 01:42:16.335850 --- ParallelTerminationStrategy: PID 10036 died... 01:42:16.355972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10036): Terminated: ok {rc=0} 01:42:16.402767 --- ParallelTerminationStrategy: PID 10039 died... 01:42:16.423212 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10039): Terminated: ok {rc=0} 01:42:16.517339 bus /sierra_3: Setting Powered False 01:42:17.628708 bus /sierra_3: Setting Powered False 01:42:18.743863 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 01:42:19.891313 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:42:19.903221 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:42:19.963094 tst mo_mt_call_osmux.py: using LAC 25112 01:42:20.081855 tst mo_mt_call_osmux.py: using RAC 122 01:42:20.208488 tst mo_mt_call_osmux.py: using CellId 25112 01:42:20.327531 tst mo_mt_call_osmux.py: using BVCI 25113 01:42:20.438232 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:42:20.449501 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:42:20.460342 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:42:20.471707 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:42:20.483022 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:42:20.494180 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:42:20.608501 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:42:20.727929 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:42:21.227291 run create_hlr_db(pid=10042): Launched 01:42:21.360538 bus /sierra_2: Setting Powered False 01:42:22.424104 run create_hlr_db(pid=10042): Terminated: ok {rc=0} 01:42:22.855173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10044): Launched 01:42:23.157585 run osmo-hlr_10.42.42.2(pid=10045): Launched 01:42:23.273803 run osmo-stp_10.42.42.5: Starting osmo-stp 01:42:23.808304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10047): Launched 01:42:24.133202 run osmo-stp_10.42.42.5(pid=10048): Launched 01:42:24.257690 run osmo-msc_10.42.42.6: Starting osmo-msc 01:42:24.842707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10050): Launched 01:42:25.167083 run osmo-msc_10.42.42.6(pid=10051): Launched 01:42:25.349126 run osmo-stp_10.42.42.5(pid=10048): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10048)] 01:42:25.485082 run osmo-stp_10.42.42.5(pid=10048): stdout: | (launched: 2022-12-10_01:42:24.073838) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:42:25.621740 run osmo-stp_10.42.42.5(pid=10048): stderr: | 20221210014224267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014224267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014224267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014224268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014224268 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014224268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014224268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:42:25.757223 run osmo-stp_10.42.42.5(pid=10048): stdout: | (launched: 2022-12-10_01:42:24.073838) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:42:25.886189 run osmo-stp_10.42.42.5(pid=10048): stderr: | 20221210014224267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014224267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014224267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014224268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014224268 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014224268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014224268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:42:26.040681 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10048): Process ended prematurely: osmo-stp_10.42.42.5(pid=10048) [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10048)] [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 01:42:26.050616 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 01:42:26.078467 run osmo-hlr_10.42.42.2(pid=10045): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10045)] 01:42:26.128336 run osmo-hlr_10.42.42.2(pid=10045): stdout: | (launched: 2022-12-10_01:42:23.101665) 01:42:26.179802 run osmo-hlr_10.42.42.2(pid=10045): stderr: | 20221210014223276 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014223276 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014223276 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014223276 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014223276 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014223276 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014223288 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014223297 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014223298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014223298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:42:26.251704 run osmo-msc_10.42.42.6(pid=10051): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10051)] 01:42:26.301788 run osmo-msc_10.42.42.6(pid=10051): stdout: | (launched: 2022-12-10_01:42:25.107682) 01:42:26.353896 run osmo-msc_10.42.42.6(pid=10051): stderr: | 20221210014225429 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210014225429 DLGLOBAL DEBUG validating counter group 0x7f4acf22fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210014225429 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210014225430 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210014225430 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210014225430 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210014225432 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210014225432 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210014225432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210014225432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:42:26.405559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10044): Terminating (SIGTERM) 01:42:26.447221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10047): Terminating (SIGTERM) 01:42:26.489068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10050): Terminating (SIGTERM) 01:42:26.531393 --- ParallelTerminationStrategy: PID 10044 died... 01:42:26.551545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10044): Terminated: ok {rc=0} 01:42:26.597863 --- ParallelTerminationStrategy: PID 10047 died... 01:42:26.617629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10047): Terminated: ok {rc=0} 01:42:26.663701 --- ParallelTerminationStrategy: PID 10050 died... 01:42:26.683335 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10050): Terminated: ok {rc=0} 01:42:26.771337 bus /sierra_3: Setting Powered False 01:42:27.871061 bus /sierra_3: Setting Powered False 01:42:28.986602 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:42:30.229951 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:42:30.238097 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:42:30.262558 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 01:42:30.290029 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:42:30.343988 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:42:30.368760 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 01:42:30.396212 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:42:30.973457 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 01:42:31.031975 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:42:31.044491 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:42:31.109586 tst mo_mt_call.py: using LAC 25113 01:42:31.236482 tst mo_mt_call.py: using RAC 123 01:42:31.390494 tst mo_mt_call.py: using CellId 25113 01:42:31.541739 tst mo_mt_call.py: using BVCI 25114 01:42:31.694303 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:42:31.710269 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:42:31.724657 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:42:31.738941 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:42:31.756298 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:42:31.772482 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:42:31.893698 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:42:32.009174 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:42:32.550501 run create_hlr_db(pid=10056): Launched 01:42:32.683864 bus /sierra_2: Setting Powered False 01:42:33.747381 run create_hlr_db(pid=10056): Terminated: ok {rc=0} 01:42:34.195648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10058): Launched 01:42:34.520041 run osmo-hlr_10.42.42.2(pid=10059): Launched 01:42:34.642928 run osmo-stp_10.42.42.5: Starting osmo-stp 01:42:35.196833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10061): Launched 01:42:35.522078 run osmo-stp_10.42.42.5(pid=10062): Launched 01:42:35.644589 run osmo-msc_10.42.42.6: Starting osmo-msc 01:42:36.202165 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10064): Launched 01:42:36.505012 run osmo-msc_10.42.42.6(pid=10065): Launched 01:42:36.679866 run osmo-stp_10.42.42.5(pid=10062): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10062)] 01:42:36.808395 run osmo-stp_10.42.42.5(pid=10062): stdout: | (launched: 2022-12-10_01:42:35.462186) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:42:36.936587 run osmo-stp_10.42.42.5(pid=10062): stderr: | 20221210014235635 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014235635 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014235635 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014235636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014235636 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014235636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014235636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:42:37.062155 run osmo-stp_10.42.42.5(pid=10062): stdout: | (launched: 2022-12-10_01:42:35.462186) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:42:37.183056 run osmo-stp_10.42.42.5(pid=10062): stderr: | 20221210014235635 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014235635 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014235635 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014235636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014235636 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014235636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014235636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:42:37.327445 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10062): Process ended prematurely: osmo-stp_10.42.42.5(pid=10062) [trial-2367↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10062)] [trial-2367↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 01:42:37.336566 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 01:42:37.363192 run osmo-hlr_10.42.42.2(pid=10059): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10059)] 01:42:37.410925 run osmo-hlr_10.42.42.2(pid=10059): stdout: | (launched: 2022-12-10_01:42:34.460848) 01:42:37.460274 run osmo-hlr_10.42.42.2(pid=10059): stderr: | 20221210014234664 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014234664 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014234664 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014234664 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014234664 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014234664 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014234676 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014234685 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014234685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014234685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:42:37.528830 run osmo-msc_10.42.42.6(pid=10065): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10065)] 01:42:37.576225 run osmo-msc_10.42.42.6(pid=10065): stdout: | (launched: 2022-12-10_01:42:36.449237) 01:42:37.625054 run osmo-msc_10.42.42.6(pid=10065): stderr: | 20221210014236721 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210014236722 DLGLOBAL DEBUG validating counter group 0x7f6202274c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210014236722 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210014236722 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210014236722 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210014236722 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210014236725 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210014236726 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210014236726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210014236726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:42:37.674798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10058): Terminating (SIGTERM) 01:42:37.714666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10061): Terminating (SIGTERM) 01:42:37.754580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10064): Terminating (SIGTERM) 01:42:37.795228 --- ParallelTerminationStrategy: PID 10058 died... 01:42:37.814354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10058): Terminated: ok {rc=0} 01:42:37.858124 --- ParallelTerminationStrategy: PID 10061 died... 01:42:37.876539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10061): Terminated: ok {rc=0} 01:42:37.920233 --- ParallelTerminationStrategy: PID 10064 died... 01:42:37.939007 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10064): Terminated: ok {rc=0} 01:42:38.024099 bus /sierra_3: Setting Powered False 01:42:39.122745 bus /sierra_3: Setting Powered False 01:42:40.237780 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 01:42:41.386799 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:42:41.399425 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:42:41.461210 tst mo_mt_call_osmux.py: using LAC 25114 01:42:41.585391 tst mo_mt_call_osmux.py: using RAC 124 01:42:41.709453 tst mo_mt_call_osmux.py: using CellId 25114 01:42:41.838305 tst mo_mt_call_osmux.py: using BVCI 25115 01:42:41.949473 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:42:41.960770 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:42:41.972045 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:42:41.984185 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:42:41.996080 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:42:42.007772 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:42:42.129879 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:42:42.247356 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:42:42.716759 run create_hlr_db(pid=10067): Launched 01:42:42.833519 bus /sierra_2: Setting Powered False 01:42:43.893488 run create_hlr_db(pid=10067): Terminated: ok {rc=0} 01:42:44.333807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10069): Launched 01:42:44.658950 run osmo-hlr_10.42.42.2(pid=10070): Launched 01:42:44.783050 run osmo-stp_10.42.42.5: Starting osmo-stp 01:42:45.339461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10072): Launched 01:42:45.663336 run osmo-stp_10.42.42.5(pid=10073): Launched 01:42:45.788380 run osmo-msc_10.42.42.6: Starting osmo-msc 01:42:46.465494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10075): Launched 01:42:46.841173 run osmo-msc_10.42.42.6(pid=10076): Launched 01:42:47.244557 run osmo-stp_10.42.42.5(pid=10073): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10073)] 01:42:47.450868 run osmo-stp_10.42.42.5(pid=10073): stdout: | (launched: 2022-12-10_01:42:45.604096) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:42:47.580705 run osmo-stp_10.42.42.5(pid=10073): stderr: | 20221210014245801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014245801 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014245801 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014245802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014245802 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014245802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014245802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:42:47.706806 run osmo-stp_10.42.42.5(pid=10073): stdout: | (launched: 2022-12-10_01:42:45.604096) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:42:47.828346 run osmo-stp_10.42.42.5(pid=10073): stderr: | 20221210014245801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014245801 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014245801 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014245802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014245802 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014245802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014245802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:42:47.972543 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10073): Process ended prematurely: osmo-stp_10.42.42.5(pid=10073) [trial-2367↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10073)] [trial-2367↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 01:42:47.981462 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 01:42:48.008460 run osmo-hlr_10.42.42.2(pid=10070): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10070)] 01:42:48.056439 run osmo-hlr_10.42.42.2(pid=10070): stdout: | (launched: 2022-12-10_01:42:44.599778) 01:42:48.106064 run osmo-hlr_10.42.42.2(pid=10070): stderr: | 20221210014244799 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014244799 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014244800 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014244800 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014244800 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014244800 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014244812 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014244820 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014244820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014244820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:42:48.174822 run osmo-msc_10.42.42.6(pid=10076): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10076)] 01:42:48.222519 run osmo-msc_10.42.42.6(pid=10076): stdout: | (launched: 2022-12-10_01:42:46.782899) 01:42:48.271742 run osmo-msc_10.42.42.6(pid=10076): stderr: | 20221210014247357 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210014247360 DLGLOBAL DEBUG validating counter group 0x7fa46541ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210014247360 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210014247360 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210014247361 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210014247361 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210014247370 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210014247370 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210014247371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210014247371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:42:48.321384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10069): Terminating (SIGTERM) 01:42:48.361280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10072): Terminating (SIGTERM) 01:42:48.401025 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10075): Terminating (SIGTERM) 01:42:48.441093 --- ParallelTerminationStrategy: PID 10069 died... 01:42:48.459992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10069): Terminated: ok {rc=0} 01:42:48.504030 --- ParallelTerminationStrategy: PID 10072 died... 01:42:48.522636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10072): Terminated: ok {rc=0} 01:42:48.566531 --- ParallelTerminationStrategy: PID 10075 died... 01:42:48.584881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10075): Terminated: ok {rc=0} 01:42:48.668786 bus /sierra_3: Setting Powered False 01:42:49.766198 bus /sierra_3: Setting Powered False 01:42:50.881454 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 emergency:nanobts+band-1900 --------------------------------------------------------------------- 01:42:52.124655 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:42:52.130602 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 01:42:52.154994 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 01:42:52.182494 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 01:42:52.270279 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 01:42:52.295254 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 01:42:52.322754 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 01:42:52.907004 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2367 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 01:42:52.912206 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:42:52.923399 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 01:42:52.963566 tst emergency_mo_mt_call.py: using LAC 25115 01:42:53.089800 tst emergency_mo_mt_call.py: using RAC 125 01:42:53.213283 tst emergency_mo_mt_call.py: using CellId 25115 01:42:53.338572 tst emergency_mo_mt_call.py: using BVCI 25116 01:42:53.453606 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:42:53.464785 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:42:53.475964 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:42:53.487032 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:42:53.498094 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:42:53.509044 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:42:53.624613 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:42:53.741570 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:42:54.234482 run create_hlr_db(pid=10081): Launched 01:42:54.366418 bus /sierra_2: Setting Powered False 01:42:55.430359 run create_hlr_db(pid=10081): Terminated: ok {rc=0} 01:42:55.871679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10083): Launched 01:42:56.189388 run osmo-hlr_10.42.42.2(pid=10084): Launched 01:42:56.312286 run osmo-stp_10.42.42.5: Starting osmo-stp 01:42:56.859848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10086): Launched 01:42:57.180084 run osmo-stp_10.42.42.5(pid=10087): Launched 01:42:57.309281 tst emergency_mo_mt_call.py: using MSISDN 7481 01:42:57.471075 run osmo-msc_10.42.42.6: Starting osmo-msc 01:42:58.043021 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10089): Launched 01:42:58.362484 run osmo-msc_10.42.42.6(pid=10090): Launched 01:42:58.541475 run osmo-stp_10.42.42.5(pid=10087): ERR: Terminated: ERROR {rc=1} [trial-2367↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10087)] 01:42:58.675702 run osmo-stp_10.42.42.5(pid=10087): stdout: | (launched: 2022-12-10_01:42:57.121174) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:42:58.810291 run osmo-stp_10.42.42.5(pid=10087): stderr: | 20221210014257315 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014257315 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014257315 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014257316 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014257316 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014257316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014257316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:42:58.944030 run osmo-stp_10.42.42.5(pid=10087): stdout: | (launched: 2022-12-10_01:42:57.121174) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:42:59.070328 run osmo-stp_10.42.42.5(pid=10087): stderr: | 20221210014257315 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014257315 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014257315 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014257316 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014257316 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014257316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014257316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:42:59.221441 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=10087): Process ended prematurely: osmo-stp_10.42.42.5(pid=10087) [trial-2367↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10087)] [trial-2367↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 01:42:59.230404 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 01:42:59.257911 run osmo-hlr_10.42.42.2(pid=10084): ERR: Terminated: ERROR {rc=237} [trial-2367↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10084)] 01:42:59.307792 run osmo-hlr_10.42.42.2(pid=10084): stdout: | (launched: 2022-12-10_01:42:56.130726) 01:42:59.359635 run osmo-hlr_10.42.42.2(pid=10084): stderr: | 20221210014256328 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014256328 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014256328 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014256328 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014256328 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014256328 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014256340 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014256349 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014256349 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014256349 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:42:59.431423 run osmo-msc_10.42.42.6(pid=10090): ERR: Terminated: ERROR {rc=2} [trial-2367↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10090)] 01:42:59.481134 run osmo-msc_10.42.42.6(pid=10090): stdout: | (launched: 2022-12-10_01:42:58.303107) 01:42:59.532551 run osmo-msc_10.42.42.6(pid=10090): stderr: | 20221210014258626 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210014258627 DLGLOBAL DEBUG validating counter group 0x7f930f5fec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210014258627 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210014258627 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210014258627 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210014258627 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210014258629 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210014258629 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210014258630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210014258630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:42:59.584292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10083): Terminating (SIGTERM) 01:42:59.625676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10086): Terminating (SIGTERM) 01:42:59.667017 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10089): Terminating (SIGTERM) 01:42:59.708770 --- ParallelTerminationStrategy: PID 10083 died... 01:42:59.728673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10083): Terminated: ok {rc=0} 01:42:59.774345 --- ParallelTerminationStrategy: PID 10086 died... 01:42:59.793654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10086): Terminated: ok {rc=0} 01:42:59.839383 --- ParallelTerminationStrategy: PID 10089 died... 01:42:59.858877 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10089): Terminated: ok {rc=0} 01:42:59.944905 bus /sierra_3: Setting Powered False 01:43:01.044254 bus /sierra_3: Setting Powered False 01:43:02.173763 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 01:43:03.270951 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:43:03.282999 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 01:43:03.324177 tst emergency_preemptive_call.py: using LAC 25116 01:43:03.448092 tst emergency_preemptive_call.py: using RAC 126 01:43:03.570333 tst emergency_preemptive_call.py: using CellId 25116 01:43:03.693405 tst emergency_preemptive_call.py: using BVCI 25117 01:43:03.807606 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:43:03.818950 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:43:03.830267 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:43:03.841462 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:43:03.852896 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:43:03.864155 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:43:03.978524 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:43:04.092923 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:43:04.210908 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:43:04.328110 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:43:04.822819 run create_hlr_db(pid=10092): Launched 01:43:04.954573 bus /sierra_2: Setting Powered False 01:43:06.018164 run create_hlr_db(pid=10092): Terminated: ok {rc=0} 01:43:06.443530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10094): Launched 01:43:06.742858 run osmo-hlr_10.42.42.2(pid=10095): Launched 01:43:06.857398 run osmo-stp_10.42.42.5: Starting osmo-stp 01:43:07.384263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10097): Launched 01:43:07.682005 run osmo-stp_10.42.42.5(pid=10098): Launched 01:43:07.807970 tst emergency_preemptive_call.py: using MSISDN 7482 01:43:07.960492 run osmo-msc_10.42.42.6: Starting osmo-msc 01:43:08.496586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10100): Launched 01:43:08.794774 run osmo-msc_10.42.42.6(pid=10101): Launched 01:43:08.964078 run osmo-stp_10.42.42.5(pid=10098): ERR: Terminated: ERROR {rc=1} [trial-2367↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10098)] 01:43:09.090535 run osmo-stp_10.42.42.5(pid=10098): stdout: | (launched: 2022-12-10_01:43:07.626548) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:43:09.216164 run osmo-stp_10.42.42.5(pid=10098): stderr: | 20221210014307795 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014307795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014307796 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014307796 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014307798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014307798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014307798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:43:09.339672 run osmo-stp_10.42.42.5(pid=10098): stdout: | (launched: 2022-12-10_01:43:07.626548) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:43:09.457422 run osmo-stp_10.42.42.5(pid=10098): stderr: | 20221210014307795 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014307795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014307796 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014307796 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014307798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014307798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014307798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:43:09.598345 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=10098): Process ended prematurely: osmo-stp_10.42.42.5(pid=10098) [trial-2367↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10098)] [trial-2367↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 01:43:09.606696 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 01:43:09.633627 run osmo-hlr_10.42.42.2(pid=10095): ERR: Terminated: ERROR {rc=237} [trial-2367↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10095)] 01:43:09.681170 run osmo-hlr_10.42.42.2(pid=10095): stdout: | (launched: 2022-12-10_01:43:06.687669) 01:43:09.730547 run osmo-hlr_10.42.42.2(pid=10095): stderr: | 20221210014306866 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014306866 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014306866 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014306866 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014306866 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014306866 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014306878 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014306887 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014306887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014306887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:43:09.799640 run osmo-msc_10.42.42.6(pid=10101): ERR: Terminated: ERROR {rc=2} [trial-2367↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10101)] 01:43:09.847256 run osmo-msc_10.42.42.6(pid=10101): stdout: | (launched: 2022-12-10_01:43:08.739089) 01:43:09.896310 run osmo-msc_10.42.42.6(pid=10101): stderr: | 20221210014309010 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210014309010 DLGLOBAL DEBUG validating counter group 0x7f9f53ed3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210014309010 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210014309010 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210014309010 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210014309010 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210014309012 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210014309013 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210014309013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210014309013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:43:09.946205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10094): Terminating (SIGTERM) 01:43:09.986132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10097): Terminating (SIGTERM) 01:43:10.025979 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10100): Terminating (SIGTERM) 01:43:10.065906 --- ParallelTerminationStrategy: PID 10094 died... 01:43:10.084769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10094): Terminated: ok {rc=0} 01:43:10.129148 --- ParallelTerminationStrategy: PID 10097 died... 01:43:10.147656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10097): Terminated: ok {rc=0} 01:43:10.191582 --- ParallelTerminationStrategy: PID 10100 died... 01:43:10.210075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10100): Terminated: ok {rc=0} 01:43:10.295575 bus /sierra_9: Setting Powered False 01:43:11.395993 bus /sierra_9: Setting Powered False 01:43:12.512823 bus /sierra_8: Setting Powered False 01:43:13.607728 bus /sierra_8: Setting Powered False 01:43:14.722324 bus /sierra_3: Setting Powered False 01:43:15.819888 bus /sierra_3: Setting Powered False 01:43:16.951292 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:nanobts+band-1900 --------------------------------------------------------------------- 01:43:18.230886 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:43:18.236545 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 01:43:18.260854 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 01:43:18.299784 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 01:43:18.390834 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 01:43:18.415446 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 01:43:18.454803 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 01:43:19.040072 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 01:43:19.094942 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:19.105983 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 01:43:19.145217 tst cs_paging_gprs_active.py: using LAC 25117 01:43:19.271649 tst cs_paging_gprs_active.py: using RAC 127 01:43:19.399202 tst cs_paging_gprs_active.py: using CellId 25117 01:43:19.525022 tst cs_paging_gprs_active.py: using BVCI 25118 01:43:19.642552 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:19.653687 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:19.664533 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:19.675548 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:19.686474 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:19.697306 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:19.708285 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:19.719066 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:19.730253 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:43:19.844379 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:43:19.963609 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:43:20.182246 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:43:20.507526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10106): Launched 01:43:20.790014 run iperf3-srv_10.42.42.10(pid=10107): Launched 01:43:20.913319 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:43:21.131306 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:43:21.457464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10108): Launched 01:43:21.740787 run iperf3-srv_10.42.42.10(pid=10109): Launched 01:43:21.863749 tst cs_paging_gprs_active.py:38: start network... 01:43:22.081723 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:43:22.584853 run create_hlr_db(pid=10110): Launched 01:43:22.717903 bus /sierra_2: Setting Powered False 01:43:23.781903 run create_hlr_db(pid=10110): Terminated: ok {rc=0} 01:43:24.232419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10112): Launched 01:43:24.556871 run osmo-hlr_10.42.42.2(pid=10113): Launched 01:43:24.680698 run osmo-stp_10.42.42.5: Starting osmo-stp 01:43:25.240401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10115): Launched 01:43:25.564831 run osmo-stp_10.42.42.5(pid=10116): Launched 01:43:25.689753 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:43:26.249966 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10118): Launched 01:43:26.374831 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:43:26.650018 run patchelf(pid=10119): Launched 01:43:26.831599 run osmo-stp_10.42.42.5(pid=10116): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10116)] 01:43:26.968697 run osmo-stp_10.42.42.5(pid=10116): stdout: | (launched: 2022-12-10_01:43:25.505268) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:43:27.107237 run osmo-stp_10.42.42.5(pid=10116): stderr: | 20221210014325699 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014325700 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014325700 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014325700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014325701 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014325701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014325701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:43:27.245828 run osmo-stp_10.42.42.5(pid=10116): stdout: | (launched: 2022-12-10_01:43:25.505268) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:43:27.379073 run osmo-stp_10.42.42.5(pid=10116): stderr: | 20221210014325699 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014325700 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014325700 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014325700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014325701 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014325701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014325701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:43:27.536304 run patchelf(pid=10119): Terminating (SIGINT) 01:43:27.717104 run patchelf(pid=10119): Terminated: ok {rc=0} 01:43:27.848113 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10116): Process ended prematurely: osmo-stp_10.42.42.5(pid=10116) [trial-2367↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10116)] [trial-2367↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 01:43:27.858476 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 01:43:27.886958 run osmo-hlr_10.42.42.2(pid=10113): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10113)] 01:43:27.936659 run osmo-hlr_10.42.42.2(pid=10113): stdout: | (launched: 2022-12-10_01:43:24.497264) 01:43:27.988064 run osmo-hlr_10.42.42.2(pid=10113): stderr: | 20221210014324697 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014324697 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014324697 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014324697 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014324697 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014324697 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014324710 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014324718 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014324718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014324719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:43:28.040011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10106): Terminating (SIGTERM) 01:43:28.082094 run iperf3-srv_10.42.42.10(pid=10107): Terminating (SIGTERM) 01:43:28.123566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10108): Terminating (SIGTERM) 01:43:28.165046 run iperf3-srv_10.42.42.10(pid=10109): Terminating (SIGTERM) 01:43:28.206362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10112): Terminating (SIGTERM) 01:43:28.247873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10115): Terminating (SIGTERM) 01:43:28.289347 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10118): Terminating (SIGTERM) 01:43:28.331490 --- ParallelTerminationStrategy: PID 10106 died... 01:43:28.351505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10106): Terminated: ok {rc=0} 01:43:28.397642 --- ParallelTerminationStrategy: PID 10107 died... 01:43:28.416868 run iperf3-srv_10.42.42.10(pid=10107): Terminated {rc=256} 01:43:28.463387 --- ParallelTerminationStrategy: PID 10108 died... 01:43:28.482927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10108): Terminated: ok {rc=0} 01:43:28.528751 --- ParallelTerminationStrategy: PID 10109 died... 01:43:28.548361 run iperf3-srv_10.42.42.10(pid=10109): Terminated {rc=256} 01:43:28.594023 --- ParallelTerminationStrategy: PID 10112 died... 01:43:28.613578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10112): Terminated: ok {rc=0} 01:43:28.659265 --- ParallelTerminationStrategy: PID 10115 died... 01:43:28.678749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10115): Terminated: ok {rc=0} 01:43:28.724436 --- ParallelTerminationStrategy: PID 10118 died... 01:43:28.743944 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10118): Terminated: ok {rc=0} 01:43:28.831378 bus /gobi_0: Setting Powered False 01:43:29.930266 bus /gobi_0: Setting Powered False 01:43:31.051301 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 01:43:32.212138 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:32.225998 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 01:43:32.265706 tst iperf3.py: using LAC 25118 01:43:32.383724 tst iperf3.py: using RAC 128 01:43:32.502566 tst iperf3.py: using CellId 25118 01:43:32.622538 tst iperf3.py: using BVCI 25119 01:43:32.731966 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:32.742700 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:32.753571 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:32.764215 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:32.774874 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:32.785721 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:32.796535 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:32.807379 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:32.818337 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:43:32.940692 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:43:33.158770 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:43:33.483354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10120): Launched 01:43:33.767148 run iperf3-srv_10.42.42.10(pid=10121): Launched 01:43:33.890880 tst iperf3.py:8: start network... 01:43:34.108820 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:43:34.611070 run create_hlr_db(pid=10122): Launched 01:43:34.745339 bus /gobi_6: Setting Powered False 01:43:35.809435 run create_hlr_db(pid=10122): Terminated: ok {rc=0} 01:43:36.242633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10124): Launched 01:43:36.546102 run osmo-hlr_10.42.42.2(pid=10125): Launched 01:43:36.664534 run osmo-stp_10.42.42.5: Starting osmo-stp 01:43:37.199091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10127): Launched 01:43:37.501561 run osmo-stp_10.42.42.5(pid=10128): Launched 01:43:37.620222 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:43:38.147243 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10130): Launched 01:43:38.263905 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:43:38.520899 run patchelf(pid=10131): Launched 01:43:38.689840 run osmo-stp_10.42.42.5(pid=10128): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10128)] 01:43:38.817986 run osmo-stp_10.42.42.5(pid=10128): stdout: | (launched: 2022-12-10_01:43:37.445600) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:43:38.947580 run osmo-stp_10.42.42.5(pid=10128): stderr: | 20221210014337619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014337619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014337620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014337620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014337621 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014337621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014337621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:43:39.077666 run osmo-stp_10.42.42.5(pid=10128): stdout: | (launched: 2022-12-10_01:43:37.445600) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:43:39.202074 run osmo-stp_10.42.42.5(pid=10128): stderr: | 20221210014337619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014337619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014337620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014337620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014337621 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014337621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014337621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:43:39.349656 run patchelf(pid=10131): Terminating (SIGINT) 01:43:39.519423 run patchelf(pid=10131): Terminated: ok {rc=0} 01:43:39.641919 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10128): Process ended prematurely: osmo-stp_10.42.42.5(pid=10128) [trial-2367↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10128)] [trial-2367↪gprs:nanobts+band-1900↪iperf3.py:8] 01:43:39.651488 tst iperf3.py:8: Test FAILED (7.5 sec) 01:43:39.679270 run osmo-hlr_10.42.42.2(pid=10125): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10125)] 01:43:39.727411 run osmo-hlr_10.42.42.2(pid=10125): stdout: | (launched: 2022-12-10_01:43:36.490110) 01:43:39.776853 run osmo-hlr_10.42.42.2(pid=10125): stderr: | 20221210014336666 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014336666 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014336666 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014336666 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014336666 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014336667 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014336682 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014336692 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014336692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014336692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:43:39.827091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10120): Terminating (SIGTERM) 01:43:39.867103 run iperf3-srv_10.42.42.10(pid=10121): Terminating (SIGTERM) 01:43:39.906803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10124): Terminating (SIGTERM) 01:43:39.946819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10127): Terminating (SIGTERM) 01:43:39.987327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10130): Terminating (SIGTERM) 01:43:40.027562 --- ParallelTerminationStrategy: PID 10120 died... 01:43:40.046676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10120): Terminated: ok {rc=0} 01:43:40.091125 --- ParallelTerminationStrategy: PID 10121 died... 01:43:40.109856 run iperf3-srv_10.42.42.10(pid=10121): Terminated {rc=256} 01:43:40.154186 --- ParallelTerminationStrategy: PID 10124 died... 01:43:40.173397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10124): Terminated: ok {rc=0} 01:43:40.217821 --- ParallelTerminationStrategy: PID 10127 died... 01:43:40.236371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10127): Terminated: ok {rc=0} 01:43:40.280864 --- ParallelTerminationStrategy: PID 10130 died... 01:43:40.300003 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10130): Terminated: ok {rc=0} 01:43:40.383814 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 01:43:41.533669 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:41.545627 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 01:43:41.589750 tst iperf3m4.py: using LAC 25119 01:43:41.715359 tst iperf3m4.py: using RAC 129 01:43:41.839538 tst iperf3m4.py: using CellId 25119 01:43:41.964156 tst iperf3m4.py: using BVCI 25120 01:43:42.081476 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:42.092578 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:42.103671 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:42.114832 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:42.125833 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:42.136666 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:42.147787 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:42.159002 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:42.170896 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:43:42.286521 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:43:42.405897 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:43:42.519834 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:43:42.634458 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:43:42.837005 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:43:43.142269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10132): Launched 01:43:43.408029 run iperf3-srv_10.42.42.10(pid=10133): Launched 01:43:43.522246 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:43:43.723407 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:43:44.027024 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10134): Launched 01:43:44.291499 run iperf3-srv_10.42.42.10(pid=10135): Launched 01:43:44.405899 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:43:44.606850 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:43:44.910501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10136): Launched 01:43:45.175790 run iperf3-srv_10.42.42.10(pid=10137): Launched 01:43:45.290035 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:43:45.490778 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:43:45.793815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10138): Launched 01:43:46.066778 run iperf3-srv_10.42.42.10(pid=10139): Launched 01:43:46.214949 tst iperf3m4.py:8: start network... 01:43:46.442171 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:43:46.958782 run create_hlr_db(pid=10140): Launched 01:43:47.122613 bus /gobi_6: Setting Powered False 01:43:48.187134 run create_hlr_db(pid=10140): Terminated: ok {rc=0} 01:43:48.620641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10142): Launched 01:43:48.926873 run osmo-hlr_10.42.42.2(pid=10143): Launched 01:43:49.043304 run osmo-stp_10.42.42.5: Starting osmo-stp 01:43:49.585916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10145): Launched 01:43:49.891644 run osmo-stp_10.42.42.5(pid=10146): Launched 01:43:50.008430 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:43:50.533411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10148): Launched 01:43:50.650848 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:43:50.909877 run patchelf(pid=10149): Launched 01:43:51.081678 run osmo-stp_10.42.42.5(pid=10146): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10146)] 01:43:51.210330 run osmo-stp_10.42.42.5(pid=10146): stdout: | (launched: 2022-12-10_01:43:49.834916) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:43:51.340568 run osmo-stp_10.42.42.5(pid=10146): stderr: | 20221210014350004 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014350005 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014350005 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014350005 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014350006 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014350006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014350006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:43:51.471242 run osmo-stp_10.42.42.5(pid=10146): stdout: | (launched: 2022-12-10_01:43:49.834916) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:43:51.596481 run osmo-stp_10.42.42.5(pid=10146): stderr: | 20221210014350004 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014350005 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014350005 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014350005 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014350006 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014350006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014350006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:43:51.744689 run patchelf(pid=10149): Terminating (SIGINT) 01:43:51.915849 run patchelf(pid=10149): Terminated: ok {rc=0} 01:43:52.038694 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10146): Process ended prematurely: osmo-stp_10.42.42.5(pid=10146) [trial-2367↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10146)] [trial-2367↪gprs:nanobts+band-1900↪iperf3m4.py:8] 01:43:52.048182 tst iperf3m4.py:8: Test FAILED (10.6 sec) 01:43:52.076036 run osmo-hlr_10.42.42.2(pid=10143): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10143)] 01:43:52.123948 run osmo-hlr_10.42.42.2(pid=10143): stdout: | (launched: 2022-12-10_01:43:48.869602) 01:43:52.173655 run osmo-hlr_10.42.42.2(pid=10143): stderr: | 20221210014349048 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014349048 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014349048 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014349049 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014349049 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014349049 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014349060 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014349069 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014349069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014349069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:43:52.223570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10132): Terminating (SIGTERM) 01:43:52.263824 run iperf3-srv_10.42.42.10(pid=10133): Terminating (SIGTERM) 01:43:52.303928 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10134): Terminating (SIGTERM) 01:43:52.343956 run iperf3-srv_10.42.42.10(pid=10135): Terminating (SIGTERM) 01:43:52.383876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10136): Terminating (SIGTERM) 01:43:52.423902 run iperf3-srv_10.42.42.10(pid=10137): Terminating (SIGTERM) 01:43:52.463664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10138): Terminating (SIGTERM) 01:43:52.503562 run iperf3-srv_10.42.42.10(pid=10139): Terminating (SIGTERM) 01:43:52.543291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10142): Terminating (SIGTERM) 01:43:52.583063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10145): Terminating (SIGTERM) 01:43:52.622815 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10148): Terminating (SIGTERM) 01:43:52.662963 --- ParallelTerminationStrategy: PID 10132 died... 01:43:52.682118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10132): Terminated: ok {rc=0} 01:43:52.726869 --- ParallelTerminationStrategy: PID 10133 died... 01:43:52.746057 run iperf3-srv_10.42.42.10(pid=10133): Terminated {rc=256} 01:43:52.790719 --- ParallelTerminationStrategy: PID 10134 died... 01:43:52.809426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10134): Terminated: ok {rc=0} 01:43:52.853360 --- ParallelTerminationStrategy: PID 10135 died... 01:43:52.871921 run iperf3-srv_10.42.42.10(pid=10135): Terminated {rc=256} 01:43:52.915981 --- ParallelTerminationStrategy: PID 10136 died... 01:43:52.934668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10136): Terminated: ok {rc=0} 01:43:52.978869 --- ParallelTerminationStrategy: PID 10137 died... 01:43:52.997532 run iperf3-srv_10.42.42.10(pid=10137): Terminated {rc=256} 01:43:53.041499 --- ParallelTerminationStrategy: PID 10138 died... 01:43:53.060097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10138): Terminated: ok {rc=0} 01:43:53.104659 --- ParallelTerminationStrategy: PID 10139 died... 01:43:53.123399 run iperf3-srv_10.42.42.10(pid=10139): Terminated {rc=256} 01:43:53.167369 --- ParallelTerminationStrategy: PID 10142 died... 01:43:53.186141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10142): Terminated: ok {rc=0} 01:43:53.230164 --- ParallelTerminationStrategy: PID 10145 died... 01:43:53.248831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10145): Terminated: ok {rc=0} 01:43:53.293020 --- ParallelTerminationStrategy: PID 10148 died... 01:43:53.311716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10148): Terminated: ok {rc=0} 01:43:53.396495 bus /gobi_4: Setting Powered False 01:43:54.495385 bus /gobi_4: Setting Powered False 01:43:55.613427 bus /gobi_1: Setting Powered False 01:43:56.711343 bus /gobi_1: Setting Powered False 01:43:57.827006 bus /gobi_0: Setting Powered False 01:43:58.924612 bus /gobi_0: Setting Powered False 01:44:00.040604 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 01:44:01.159793 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:01.172780 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 01:44:01.216554 tst ping.py: using LAC 25120 01:44:01.388483 tst ping.py: using RAC 130 01:44:01.518630 tst ping.py: using CellId 25120 01:44:01.634882 tst ping.py: using BVCI 25121 01:44:01.773710 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:01.785060 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:01.796134 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:01.807604 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:01.819235 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:01.830356 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:01.841810 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:01.853589 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:44:01.990482 tst ping.py:19: start network... 01:44:02.223755 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:44:02.720401 run create_hlr_db(pid=10150): Launched 01:44:02.847194 bus /gobi_6: Setting Powered False 01:44:03.906022 run create_hlr_db(pid=10150): Terminated: ok {rc=0} 01:44:04.340032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10152): Launched 01:44:04.662269 run osmo-hlr_10.42.42.2(pid=10153): Launched 01:44:04.785765 run osmo-stp_10.42.42.5: Starting osmo-stp 01:44:05.338795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10155): Launched 01:44:05.659341 run osmo-stp_10.42.42.5(pid=10156): Launched 01:44:05.781786 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:44:06.330804 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10158): Launched 01:44:06.455312 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:44:06.725174 run patchelf(pid=10159): Launched 01:44:06.904756 run osmo-stp_10.42.42.5(pid=10156): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10156)] 01:44:07.039479 run osmo-stp_10.42.42.5(pid=10156): stdout: | (launched: 2022-12-10_01:44:05.600671) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:44:07.176069 run osmo-stp_10.42.42.5(pid=10156): stderr: | 20221210014405794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014405794 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014405794 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014405795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014405797 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014405797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014405797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:44:07.312728 run osmo-stp_10.42.42.5(pid=10156): stdout: | (launched: 2022-12-10_01:44:05.600671) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:44:07.444718 run osmo-stp_10.42.42.5(pid=10156): stderr: | 20221210014405794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014405794 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014405794 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014405795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014405797 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014405797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014405797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:44:07.600392 run patchelf(pid=10159): Terminating (SIGINT) 01:44:07.779015 run patchelf(pid=10159): Terminated: ok {rc=0} 01:44:07.907563 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10156): Process ended prematurely: osmo-stp_10.42.42.5(pid=10156) [trial-2367↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10156)] [trial-2367↪gprs:nanobts+band-1900↪ping.py:22] 01:44:07.916888 tst ping.py:22: Test FAILED (6.7 sec) 01:44:07.945484 run osmo-hlr_10.42.42.2(pid=10153): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10153)] 01:44:07.995877 run osmo-hlr_10.42.42.2(pid=10153): stdout: | (launched: 2022-12-10_01:44:04.603446) 01:44:08.048250 run osmo-hlr_10.42.42.2(pid=10153): stderr: | 20221210014404803 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014404803 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014404803 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014404803 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014404803 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014404803 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014404816 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014404825 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014404825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014404825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:44:08.100726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10152): Terminating (SIGTERM) 01:44:08.142962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10155): Terminating (SIGTERM) 01:44:08.185297 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10158): Terminating (SIGTERM) 01:44:08.228171 --- ParallelTerminationStrategy: PID 10152 died... 01:44:08.248435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10152): Terminated: ok {rc=0} 01:44:08.295849 --- ParallelTerminationStrategy: PID 10155 died... 01:44:08.315923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10155): Terminated: ok {rc=0} 01:44:08.363234 --- ParallelTerminationStrategy: PID 10158 died... 01:44:08.383219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10158): Terminated: ok {rc=0} 01:44:08.471510 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 01:44:09.560687 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:09.572705 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 01:44:09.614341 tst ping_idle_ping.py: using LAC 25121 01:44:09.733370 tst ping_idle_ping.py: using RAC 131 01:44:09.850886 tst ping_idle_ping.py: using CellId 25121 01:44:09.969938 tst ping_idle_ping.py: using BVCI 25122 01:44:10.078570 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:10.089642 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:10.100327 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:10.111746 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:10.122981 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:10.135158 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:10.145960 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:10.157756 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:44:10.273226 tst ping_idle_ping.py:24: start network... 01:44:10.473926 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:44:10.941048 run create_hlr_db(pid=10160): Launched 01:44:11.055895 bus /gobi_6: Setting Powered False 01:44:12.116284 run create_hlr_db(pid=10160): Terminated: ok {rc=0} 01:44:12.554695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10162): Launched 01:44:12.877584 run osmo-hlr_10.42.42.2(pid=10163): Launched 01:44:13.001624 run osmo-stp_10.42.42.5: Starting osmo-stp 01:44:13.554159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10165): Launched 01:44:13.878007 run osmo-stp_10.42.42.5(pid=10166): Launched 01:44:14.001685 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:44:14.556907 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10168): Launched 01:44:14.682368 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:44:14.953817 run patchelf(pid=10169): Launched 01:44:15.132661 run osmo-stp_10.42.42.5(pid=10166): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10166)] 01:44:15.268442 run osmo-stp_10.42.42.5(pid=10166): stdout: | (launched: 2022-12-10_01:44:13.818402) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:44:15.406151 run osmo-stp_10.42.42.5(pid=10166): stderr: | 20221210014414012 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014414012 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014414012 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014414013 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014414013 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014414013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014414013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:44:15.542746 run osmo-stp_10.42.42.5(pid=10166): stdout: | (launched: 2022-12-10_01:44:13.818402) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:44:15.674978 run osmo-stp_10.42.42.5(pid=10166): stderr: | 20221210014414012 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014414012 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014414012 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014414013 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014414013 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014414013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014414013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:44:15.831312 run patchelf(pid=10169): Terminating (SIGINT) 01:44:16.032798 run patchelf(pid=10169): Terminated: ok {rc=0} 01:44:16.167034 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10166): Process ended prematurely: osmo-stp_10.42.42.5(pid=10166) [trial-2367↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10166)] [trial-2367↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 01:44:16.177081 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 01:44:16.206129 run osmo-hlr_10.42.42.2(pid=10163): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10163)] 01:44:16.257677 run osmo-hlr_10.42.42.2(pid=10163): stdout: | (launched: 2022-12-10_01:44:12.818551) 01:44:16.310981 run osmo-hlr_10.42.42.2(pid=10163): stderr: | 20221210014413020 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014413020 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014413020 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014413020 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014413020 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014413020 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014413033 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014413041 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014413041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014413041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:44:16.365133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10162): Terminating (SIGTERM) 01:44:16.408653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10165): Terminating (SIGTERM) 01:44:16.452380 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10168): Terminating (SIGTERM) 01:44:16.496026 --- ParallelTerminationStrategy: PID 10162 died... 01:44:16.516588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10162): Terminated: ok {rc=0} 01:44:16.564427 --- ParallelTerminationStrategy: PID 10165 died... 01:44:16.584886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10165): Terminated: ok {rc=0} 01:44:16.632598 --- ParallelTerminationStrategy: PID 10168 died... 01:44:16.652758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10168): Terminated: ok {rc=0} 01:44:16.741775 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 01:44:18.044339 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:44:18.050963 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 01:44:18.075321 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 01:44:18.114611 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 01:44:18.202392 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 01:44:18.226550 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 01:44:18.265558 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 01:44:18.863354 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 01:44:18.915228 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:18.926621 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:44:18.968358 tst cs_paging_gprs_active.py: using LAC 25122 01:44:19.097334 tst cs_paging_gprs_active.py: using RAC 132 01:44:19.224618 tst cs_paging_gprs_active.py: using CellId 25122 01:44:19.353095 tst cs_paging_gprs_active.py: using BVCI 25123 01:44:19.473147 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:19.484567 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:19.495782 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:19.507008 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:19.518230 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:19.529375 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:19.540653 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:19.551756 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:19.563069 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:44:19.682787 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:44:19.799471 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:44:20.003368 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:44:20.309260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10174): Launched 01:44:20.575977 run iperf3-srv_10.42.42.10(pid=10175): Launched 01:44:20.692337 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:44:20.895045 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:44:21.200321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10176): Launched 01:44:21.465092 run iperf3-srv_10.42.42.10(pid=10177): Launched 01:44:21.579306 tst cs_paging_gprs_active.py:38: start network... 01:44:21.782208 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:44:22.252370 run create_hlr_db(pid=10178): Launched 01:44:22.369557 bus /gobi_6: Setting Powered False 01:44:23.430223 run create_hlr_db(pid=10178): Terminated: ok {rc=0} 01:44:23.852916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10180): Launched 01:44:24.158112 run osmo-hlr_10.42.42.2(pid=10181): Launched 01:44:24.274298 run osmo-stp_10.42.42.5: Starting osmo-stp 01:44:24.814971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10183): Launched 01:44:25.122678 run osmo-stp_10.42.42.5(pid=10184): Launched 01:44:25.239993 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:44:25.764875 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10186): Launched 01:44:25.881983 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:44:26.140494 run patchelf(pid=10187): Launched 01:44:26.310139 run osmo-stp_10.42.42.5(pid=10184): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10184)] 01:44:26.438531 run osmo-stp_10.42.42.5(pid=10184): stdout: | (launched: 2022-12-10_01:44:25.066172) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:44:26.568642 run osmo-stp_10.42.42.5(pid=10184): stderr: | 20221210014425237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014425237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014425237 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014425238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014425240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014425240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014425240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:44:26.698829 run osmo-stp_10.42.42.5(pid=10184): stdout: | (launched: 2022-12-10_01:44:25.066172) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:44:26.823150 run osmo-stp_10.42.42.5(pid=10184): stderr: | 20221210014425237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014425237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014425237 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014425238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014425240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014425240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014425240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:44:26.970532 run patchelf(pid=10187): Terminating (SIGINT) 01:44:27.140008 run patchelf(pid=10187): Terminated: ok {rc=0} 01:44:27.262084 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10184): Process ended prematurely: osmo-stp_10.42.42.5(pid=10184) [trial-2367↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10184)] [trial-2367↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 01:44:27.271620 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 01:44:27.299578 run osmo-hlr_10.42.42.2(pid=10181): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10181)] 01:44:27.347802 run osmo-hlr_10.42.42.2(pid=10181): stdout: | (launched: 2022-12-10_01:44:24.100454) 01:44:27.398000 run osmo-hlr_10.42.42.2(pid=10181): stderr: | 20221210014424279 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014424279 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014424279 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014424279 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014424280 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014424280 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014424292 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014424301 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014424301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014424301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:44:27.448605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10174): Terminating (SIGTERM) 01:44:27.488795 run iperf3-srv_10.42.42.10(pid=10175): Terminating (SIGTERM) 01:44:27.528580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10176): Terminating (SIGTERM) 01:44:27.568445 run iperf3-srv_10.42.42.10(pid=10177): Terminating (SIGTERM) 01:44:27.608266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10180): Terminating (SIGTERM) 01:44:27.648045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10183): Terminating (SIGTERM) 01:44:27.687924 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10186): Terminating (SIGTERM) 01:44:27.728156 --- ParallelTerminationStrategy: PID 10174 died... 01:44:27.747418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10174): Terminated: ok {rc=0} 01:44:27.792255 --- ParallelTerminationStrategy: PID 10175 died... 01:44:27.810827 run iperf3-srv_10.42.42.10(pid=10175): Terminated {rc=256} 01:44:27.854743 --- ParallelTerminationStrategy: PID 10176 died... 01:44:27.873539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10176): Terminated: ok {rc=0} 01:44:27.917488 --- ParallelTerminationStrategy: PID 10177 died... 01:44:27.935995 run iperf3-srv_10.42.42.10(pid=10177): Terminated {rc=256} 01:44:27.979678 --- ParallelTerminationStrategy: PID 10180 died... 01:44:27.998360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10180): Terminated: ok {rc=0} 01:44:28.042448 --- ParallelTerminationStrategy: PID 10183 died... 01:44:28.061199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10183): Terminated: ok {rc=0} 01:44:28.105441 --- ParallelTerminationStrategy: PID 10186 died... 01:44:28.124184 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10186): Terminated: ok {rc=0} 01:44:28.209293 bus /gobi_0: Setting Powered False 01:44:29.307753 bus /gobi_0: Setting Powered False 01:44:30.422498 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 01:44:31.599451 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:31.613957 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:44:31.659566 tst iperf3.py: using LAC 25123 01:44:31.785495 tst iperf3.py: using RAC 133 01:44:31.945364 tst iperf3.py: using CellId 25123 01:44:32.105585 tst iperf3.py: using BVCI 25124 01:44:32.257269 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:32.269399 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:32.281718 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:32.295768 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:32.308904 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:32.320522 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:32.333883 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:32.345404 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:32.356555 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:44:32.475660 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:44:32.696536 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:44:33.022214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10188): Launched 01:44:33.306407 run iperf3-srv_10.42.42.10(pid=10189): Launched 01:44:33.430828 tst iperf3.py:8: start network... 01:44:33.648916 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:44:34.151098 run create_hlr_db(pid=10190): Launched 01:44:34.284158 bus /gobi_6: Setting Powered False 01:44:35.348874 run create_hlr_db(pid=10190): Terminated: ok {rc=0} 01:44:35.799120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10192): Launched 01:44:36.125030 run osmo-hlr_10.42.42.2(pid=10193): Launched 01:44:36.249131 run osmo-stp_10.42.42.5: Starting osmo-stp 01:44:36.815931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10195): Launched 01:44:37.140059 run osmo-stp_10.42.42.5(pid=10196): Launched 01:44:37.264118 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:44:37.824892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10198): Launched 01:44:37.950966 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:44:38.224901 run patchelf(pid=10199): Launched 01:44:38.407626 run osmo-stp_10.42.42.5(pid=10196): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10196)] 01:44:38.544710 run osmo-stp_10.42.42.5(pid=10196): stdout: | (launched: 2022-12-10_01:44:37.080409) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:44:38.683739 run osmo-stp_10.42.42.5(pid=10196): stderr: | 20221210014437272 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014437272 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014437273 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014437273 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014437273 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014437274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014437274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:44:38.822742 run osmo-stp_10.42.42.5(pid=10196): stdout: | (launched: 2022-12-10_01:44:37.080409) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:44:38.955647 run osmo-stp_10.42.42.5(pid=10196): stderr: | 20221210014437272 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014437272 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014437273 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014437273 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014437273 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014437274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014437274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:44:39.113639 run patchelf(pid=10199): Terminating (SIGINT) 01:44:39.294659 run patchelf(pid=10199): Terminated: ok {rc=0} 01:44:39.425638 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10196): Process ended prematurely: osmo-stp_10.42.42.5(pid=10196) [trial-2367↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10196)] [trial-2367↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 01:44:39.435877 tst iperf3.py:8: Test FAILED (7.9 sec) 01:44:39.464465 run osmo-hlr_10.42.42.2(pid=10193): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10193)] 01:44:39.514559 run osmo-hlr_10.42.42.2(pid=10193): stdout: | (launched: 2022-12-10_01:44:36.065268) 01:44:39.566013 run osmo-hlr_10.42.42.2(pid=10193): stderr: | 20221210014436264 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014436264 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014436264 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014436264 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014436264 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014436264 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014436277 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014436285 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014436286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014436286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:44:39.617915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10188): Terminating (SIGTERM) 01:44:39.659648 run iperf3-srv_10.42.42.10(pid=10189): Terminating (SIGTERM) 01:44:39.701425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10192): Terminating (SIGTERM) 01:44:39.743099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10195): Terminating (SIGTERM) 01:44:39.785178 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10198): Terminating (SIGTERM) 01:44:39.827663 --- ParallelTerminationStrategy: PID 10188 died... 01:44:39.847891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10188): Terminated: ok {rc=0} 01:44:39.894530 --- ParallelTerminationStrategy: PID 10189 died... 01:44:39.914195 run iperf3-srv_10.42.42.10(pid=10189): Terminated {rc=256} 01:44:39.960359 --- ParallelTerminationStrategy: PID 10192 died... 01:44:39.980176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10192): Terminated: ok {rc=0} 01:44:40.026230 --- ParallelTerminationStrategy: PID 10195 died... 01:44:40.045971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10195): Terminated: ok {rc=0} 01:44:40.092108 --- ParallelTerminationStrategy: PID 10198 died... 01:44:40.111915 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10198): Terminated: ok {rc=0} 01:44:40.199932 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 01:44:41.350794 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:41.363171 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:44:41.405667 tst iperf3m4.py: using LAC 25124 01:44:41.534751 tst iperf3m4.py: using RAC 134 01:44:41.663874 tst iperf3m4.py: using CellId 25124 01:44:41.790869 tst iperf3m4.py: using BVCI 25125 01:44:41.910729 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:41.932552 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:41.944063 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:41.955448 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:41.966708 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:41.978296 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:41.989915 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:42.001265 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:42.012686 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:44:42.131944 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:44:42.251485 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:44:42.370777 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:44:42.489304 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:44:42.708007 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:44:43.035648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10200): Launched 01:44:43.319684 run iperf3-srv_10.42.42.10(pid=10201): Launched 01:44:43.444397 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:44:43.662495 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:44:43.989081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10202): Launched 01:44:44.273154 run iperf3-srv_10.42.42.10(pid=10203): Launched 01:44:44.395757 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:44:44.614464 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:44:44.941178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10204): Launched 01:44:45.225994 run iperf3-srv_10.42.42.10(pid=10205): Launched 01:44:45.350168 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:44:45.569547 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:44:45.905576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10206): Launched 01:44:46.207560 run iperf3-srv_10.42.42.10(pid=10207): Launched 01:44:46.347268 tst iperf3m4.py:8: start network... 01:44:46.572056 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:44:47.088166 run create_hlr_db(pid=10208): Launched 01:44:47.248077 bus /gobi_6: Setting Powered False 01:44:48.309614 run create_hlr_db(pid=10208): Terminated: ok {rc=0} 01:44:48.754028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10210): Launched 01:44:49.064150 run osmo-hlr_10.42.42.2(pid=10211): Launched 01:44:49.180412 run osmo-stp_10.42.42.5: Starting osmo-stp 01:44:49.706636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10213): Launched 01:44:50.012751 run osmo-stp_10.42.42.5(pid=10214): Launched 01:44:50.130499 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:44:50.655001 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10216): Launched 01:44:50.772529 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:44:51.030117 run patchelf(pid=10217): Launched 01:44:51.200478 run osmo-stp_10.42.42.5(pid=10214): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10214)] 01:44:51.328918 run osmo-stp_10.42.42.5(pid=10214): stdout: | (launched: 2022-12-10_01:44:49.955895) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:44:51.458815 run osmo-stp_10.42.42.5(pid=10214): stderr: | 20221210014450124 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014450124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014450125 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014450125 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014450125 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014450126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014450126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:44:51.589243 run osmo-stp_10.42.42.5(pid=10214): stdout: | (launched: 2022-12-10_01:44:49.955895) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:44:51.713821 run osmo-stp_10.42.42.5(pid=10214): stderr: | 20221210014450124 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014450124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014450125 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014450125 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014450125 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014450126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014450126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:44:51.861752 run patchelf(pid=10217): Terminating (SIGINT) 01:44:52.032335 run patchelf(pid=10217): Terminated: ok {rc=0} 01:44:52.155157 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10214): Process ended prematurely: osmo-stp_10.42.42.5(pid=10214) [trial-2367↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10214)] [trial-2367↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 01:44:52.165047 tst iperf3m4.py:8: Test FAILED (10.9 sec) 01:44:52.192914 run osmo-hlr_10.42.42.2(pid=10211): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10211)] 01:44:52.240474 run osmo-hlr_10.42.42.2(pid=10211): stdout: | (launched: 2022-12-10_01:44:49.006949) 01:44:52.289528 run osmo-hlr_10.42.42.2(pid=10211): stderr: | 20221210014449187 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014449187 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014449187 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014449187 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014449187 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014449187 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014449199 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014449209 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014449209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014449210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:44:52.339434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10200): Terminating (SIGTERM) 01:44:52.379140 run iperf3-srv_10.42.42.10(pid=10201): Terminating (SIGTERM) 01:44:52.418655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10202): Terminating (SIGTERM) 01:44:52.458280 run iperf3-srv_10.42.42.10(pid=10203): Terminating (SIGTERM) 01:44:52.497627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10204): Terminating (SIGTERM) 01:44:52.537192 run iperf3-srv_10.42.42.10(pid=10205): Terminating (SIGTERM) 01:44:52.576671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10206): Terminating (SIGTERM) 01:44:52.616208 run iperf3-srv_10.42.42.10(pid=10207): Terminating (SIGTERM) 01:44:52.655523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10210): Terminating (SIGTERM) 01:44:52.695174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10213): Terminating (SIGTERM) 01:44:52.735156 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10216): Terminating (SIGTERM) 01:44:52.775100 --- ParallelTerminationStrategy: PID 10200 died... 01:44:52.794080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10200): Terminated: ok {rc=0} 01:44:52.838602 --- ParallelTerminationStrategy: PID 10201 died... 01:44:52.856852 run iperf3-srv_10.42.42.10(pid=10201): Terminated {rc=256} 01:44:52.900769 --- ParallelTerminationStrategy: PID 10202 died... 01:44:52.919371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10202): Terminated: ok {rc=0} 01:44:52.963436 --- ParallelTerminationStrategy: PID 10203 died... 01:44:52.981906 run iperf3-srv_10.42.42.10(pid=10203): Terminated {rc=256} 01:44:53.025799 --- ParallelTerminationStrategy: PID 10204 died... 01:44:53.044310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10204): Terminated: ok {rc=0} 01:44:53.088317 --- ParallelTerminationStrategy: PID 10205 died... 01:44:53.106874 run iperf3-srv_10.42.42.10(pid=10205): Terminated {rc=256} 01:44:53.150853 --- ParallelTerminationStrategy: PID 10206 died... 01:44:53.169443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10206): Terminated: ok {rc=0} 01:44:53.213513 --- ParallelTerminationStrategy: PID 10207 died... 01:44:53.232077 run iperf3-srv_10.42.42.10(pid=10207): Terminated {rc=256} 01:44:53.276026 --- ParallelTerminationStrategy: PID 10210 died... 01:44:53.294602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10210): Terminated: ok {rc=0} 01:44:53.338708 --- ParallelTerminationStrategy: PID 10213 died... 01:44:53.357322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10213): Terminated: ok {rc=0} 01:44:53.401564 --- ParallelTerminationStrategy: PID 10216 died... 01:44:53.420361 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10216): Terminated: ok {rc=0} 01:44:53.505177 bus /gobi_4: Setting Powered False 01:44:54.602743 bus /gobi_4: Setting Powered False 01:44:55.718449 bus /gobi_1: Setting Powered False 01:44:56.816891 bus /gobi_1: Setting Powered False 01:44:57.931856 bus /gobi_0: Setting Powered False 01:44:59.030106 bus /gobi_0: Setting Powered False 01:45:00.145992 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 01:45:01.246469 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:01.259148 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:45:01.302814 tst ping.py: using LAC 25125 01:45:01.423277 tst ping.py: using RAC 135 01:45:01.543360 tst ping.py: using CellId 25125 01:45:01.670232 tst ping.py: using BVCI 25126 01:45:01.822603 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:01.834836 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:01.847979 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:01.860921 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:01.872676 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:01.885584 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:01.899629 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:01.912419 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:45:02.031014 tst ping.py:19: start network... 01:45:02.235156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:45:02.727627 run create_hlr_db(pid=10221): Launched 01:45:02.857657 bus /gobi_6: Setting Powered False 01:45:03.920527 run create_hlr_db(pid=10221): Terminated: ok {rc=0} 01:45:04.345575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10223): Launched 01:45:04.645631 run osmo-hlr_10.42.42.2(pid=10224): Launched 01:45:04.759949 run osmo-stp_10.42.42.5: Starting osmo-stp 01:45:05.287838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10226): Launched 01:45:05.587500 run osmo-stp_10.42.42.5(pid=10227): Launched 01:45:05.704287 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:45:06.219825 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10229): Launched 01:45:06.334607 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:45:06.586573 run patchelf(pid=10230): Launched 01:45:06.754446 run osmo-stp_10.42.42.5(pid=10227): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10227)] 01:45:06.881039 run osmo-stp_10.42.42.5(pid=10227): stdout: | (launched: 2022-12-10_01:45:05.531816) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:45:07.008132 run osmo-stp_10.42.42.5(pid=10227): stderr: | 20221210014505703 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014505703 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014505703 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014505704 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014505704 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014505704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014505704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:45:07.136304 run osmo-stp_10.42.42.5(pid=10227): stdout: | (launched: 2022-12-10_01:45:05.531816) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:45:07.258829 run osmo-stp_10.42.42.5(pid=10227): stderr: | 20221210014505703 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014505703 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014505703 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014505704 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014505704 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014505704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014505704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:45:07.404043 run patchelf(pid=10230): Terminating (SIGINT) 01:45:07.571181 run patchelf(pid=10230): Terminated: ok {rc=0} 01:45:07.691774 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10227): Process ended prematurely: osmo-stp_10.42.42.5(pid=10227) [trial-2367↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10227)] [trial-2367↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 01:45:07.700696 tst ping.py:22: Test FAILED (6.4 sec) 01:45:07.728059 run osmo-hlr_10.42.42.2(pid=10224): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10224)] 01:45:07.775572 run osmo-hlr_10.42.42.2(pid=10224): stdout: | (launched: 2022-12-10_01:45:04.589898) 01:45:07.824626 run osmo-hlr_10.42.42.2(pid=10224): stderr: | 20221210014504767 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014504767 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014504767 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014504767 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014504767 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014504767 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014504779 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014504788 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014504789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014504789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:45:07.874274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10223): Terminating (SIGTERM) 01:45:07.914062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10226): Terminating (SIGTERM) 01:45:07.953649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10229): Terminating (SIGTERM) 01:45:07.993716 --- ParallelTerminationStrategy: PID 10223 died... 01:45:08.012772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10223): Terminated: ok {rc=0} 01:45:08.057154 --- ParallelTerminationStrategy: PID 10226 died... 01:45:08.075740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10226): Terminated: ok {rc=0} 01:45:08.119878 --- ParallelTerminationStrategy: PID 10229 died... 01:45:08.138599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10229): Terminated: ok {rc=0} 01:45:08.222431 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 01:45:09.307153 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:09.318803 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:45:09.361337 tst ping_idle_ping.py: using LAC 25126 01:45:09.479298 tst ping_idle_ping.py: using RAC 136 01:45:09.597116 tst ping_idle_ping.py: using CellId 25126 01:45:09.714319 tst ping_idle_ping.py: using BVCI 25127 01:45:09.823992 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:09.835123 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:09.845993 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:09.856891 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:09.867833 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:09.878896 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:09.890119 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:09.901186 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:45:10.020632 tst ping_idle_ping.py:24: start network... 01:45:10.237096 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:45:10.739070 run create_hlr_db(pid=10231): Launched 01:45:10.870129 bus /gobi_6: Setting Powered False 01:45:11.934434 run create_hlr_db(pid=10231): Terminated: ok {rc=0} 01:45:12.363872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10233): Launched 01:45:12.664701 run osmo-hlr_10.42.42.2(pid=10234): Launched 01:45:12.780477 run osmo-stp_10.42.42.5: Starting osmo-stp 01:45:13.300728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10236): Launched 01:45:13.600738 run osmo-stp_10.42.42.5(pid=10237): Launched 01:45:13.718977 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:45:14.235876 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10239): Launched 01:45:14.351205 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:45:14.603470 run patchelf(pid=10240): Launched 01:45:14.770267 run osmo-stp_10.42.42.5(pid=10237): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10237)] 01:45:14.896895 run osmo-stp_10.42.42.5(pid=10237): stdout: | (launched: 2022-12-10_01:45:13.545331) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:45:15.024893 run osmo-stp_10.42.42.5(pid=10237): stderr: | 20221210014513714 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014513714 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014513714 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014513715 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014513717 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014513717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014513717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:45:15.152630 run osmo-stp_10.42.42.5(pid=10237): stdout: | (launched: 2022-12-10_01:45:13.545331) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:45:15.276005 run osmo-stp_10.42.42.5(pid=10237): stderr: | 20221210014513714 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014513714 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014513714 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014513715 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014513717 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014513717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014513717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:45:15.423584 run patchelf(pid=10240): Terminating (SIGINT) 01:45:15.590745 run patchelf(pid=10240): Terminated: ok {rc=0} 01:45:15.711186 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10237): Process ended prematurely: osmo-stp_10.42.42.5(pid=10237) [trial-2367↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10237)] [trial-2367↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 01:45:15.720091 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 01:45:15.747091 run osmo-hlr_10.42.42.2(pid=10234): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10234)] 01:45:15.795428 run osmo-hlr_10.42.42.2(pid=10234): stdout: | (launched: 2022-12-10_01:45:12.608855) 01:45:15.850023 run osmo-hlr_10.42.42.2(pid=10234): stderr: | 20221210014512787 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014512788 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014512788 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014512788 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014512788 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014512788 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014512800 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014512808 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014512808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014512808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:45:15.906741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10233): Terminating (SIGTERM) 01:45:15.948105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10236): Terminating (SIGTERM) 01:45:15.989287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10239): Terminating (SIGTERM) 01:45:16.031649 --- ParallelTerminationStrategy: PID 10233 died... 01:45:16.051360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10233): Terminated: ok {rc=0} 01:45:16.098961 --- ParallelTerminationStrategy: PID 10236 died... 01:45:16.118501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10236): Terminated: ok {rc=0} 01:45:16.164412 --- ParallelTerminationStrategy: PID 10239 died... 01:45:16.183863 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10239): Terminated: ok {rc=0} 01:45:16.268927 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 01:45:17.561279 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:45:17.568428 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 01:45:17.592799 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 01:45:17.630914 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 01:45:17.717315 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 01:45:17.740674 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 01:45:17.778672 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 01:45:18.374599 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 01:45:18.424174 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:18.435204 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:45:18.493957 tst cs_paging_gprs_active.py: using LAC 25127 01:45:18.611748 tst cs_paging_gprs_active.py: using RAC 137 01:45:18.732767 tst cs_paging_gprs_active.py: using CellId 25127 01:45:18.852863 tst cs_paging_gprs_active.py: using BVCI 25128 01:45:18.962908 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:18.973955 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:18.984723 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:18.995925 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:19.006871 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:19.018003 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:19.029130 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:19.039994 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:19.051152 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:45:19.171201 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:45:19.291357 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:45:19.511413 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:45:19.838702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10245): Launched 01:45:20.122683 run iperf3-srv_10.42.42.10(pid=10246): Launched 01:45:20.245059 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:45:20.464345 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:45:20.790407 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10247): Launched 01:45:21.073235 run iperf3-srv_10.42.42.10(pid=10248): Launched 01:45:21.195203 tst cs_paging_gprs_active.py:38: start network... 01:45:21.413796 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:45:21.918394 run create_hlr_db(pid=10249): Launched 01:45:22.050964 bus /gobi_6: Setting Powered False 01:45:23.115226 run create_hlr_db(pid=10249): Terminated: ok {rc=0} 01:45:23.549267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10251): Launched 01:45:23.854649 run osmo-hlr_10.42.42.2(pid=10252): Launched 01:45:23.971711 run osmo-stp_10.42.42.5: Starting osmo-stp 01:45:24.511171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10254): Launched 01:45:24.816211 run osmo-stp_10.42.42.5(pid=10255): Launched 01:45:24.933116 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:45:25.459339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10257): Launched 01:45:25.576751 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:45:25.834319 run patchelf(pid=10258): Launched 01:45:26.003726 run osmo-stp_10.42.42.5(pid=10255): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10255)] 01:45:26.132488 run osmo-stp_10.42.42.5(pid=10255): stdout: | (launched: 2022-12-10_01:45:24.759958) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:45:26.262694 run osmo-stp_10.42.42.5(pid=10255): stderr: | 20221210014524930 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014524930 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014524931 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014524931 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014524932 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014524932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014524932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:45:26.392392 run osmo-stp_10.42.42.5(pid=10255): stdout: | (launched: 2022-12-10_01:45:24.759958) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:45:26.516638 run osmo-stp_10.42.42.5(pid=10255): stderr: | 20221210014524930 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014524930 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014524931 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014524931 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014524932 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014524932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014524932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:45:26.664550 run patchelf(pid=10258): Terminating (SIGINT) 01:45:26.834845 run patchelf(pid=10258): Terminated: ok {rc=0} 01:45:26.957246 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10255): Process ended prematurely: osmo-stp_10.42.42.5(pid=10255) [trial-2367↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10255)] [trial-2367↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 01:45:26.966718 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 01:45:26.994735 run osmo-hlr_10.42.42.2(pid=10252): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10252)] 01:45:27.042411 run osmo-hlr_10.42.42.2(pid=10252): stdout: | (launched: 2022-12-10_01:45:23.797851) 01:45:27.091852 run osmo-hlr_10.42.42.2(pid=10252): stderr: | 20221210014523977 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014523977 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014523977 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014523977 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014523977 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014523977 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014523989 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014523998 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014523998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014523998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:45:27.141638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10245): Terminating (SIGTERM) 01:45:27.181360 run iperf3-srv_10.42.42.10(pid=10246): Terminating (SIGTERM) 01:45:27.221063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10247): Terminating (SIGTERM) 01:45:27.260996 run iperf3-srv_10.42.42.10(pid=10248): Terminating (SIGTERM) 01:45:27.300536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10251): Terminating (SIGTERM) 01:45:27.340212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10254): Terminating (SIGTERM) 01:45:27.379981 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10257): Terminating (SIGTERM) 01:45:27.419977 --- ParallelTerminationStrategy: PID 10245 died... 01:45:27.438934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10245): Terminated: ok {rc=0} 01:45:27.482991 --- ParallelTerminationStrategy: PID 10246 died... 01:45:27.501409 run iperf3-srv_10.42.42.10(pid=10246): Terminated {rc=256} 01:45:27.545121 --- ParallelTerminationStrategy: PID 10247 died... 01:45:27.563536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10247): Terminated: ok {rc=0} 01:45:27.607485 --- ParallelTerminationStrategy: PID 10248 died... 01:45:27.625894 run iperf3-srv_10.42.42.10(pid=10248): Terminated {rc=256} 01:45:27.669573 --- ParallelTerminationStrategy: PID 10251 died... 01:45:27.687816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10251): Terminated: ok {rc=0} 01:45:27.731668 --- ParallelTerminationStrategy: PID 10254 died... 01:45:27.750123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10254): Terminated: ok {rc=0} 01:45:27.793760 --- ParallelTerminationStrategy: PID 10257 died... 01:45:27.812016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10257): Terminated: ok {rc=0} 01:45:27.895505 bus /gobi_0: Setting Powered False 01:45:28.992749 bus /gobi_0: Setting Powered False 01:45:30.109004 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 01:45:31.256677 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:31.269674 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:45:31.332754 tst iperf3.py: using LAC 25128 01:45:31.469287 tst iperf3.py: using RAC 138 01:45:31.590723 tst iperf3.py: using CellId 25128 01:45:31.726873 tst iperf3.py: using BVCI 25129 01:45:31.849181 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:31.861811 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:31.874610 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:31.887352 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:31.899568 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:31.911779 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:31.924024 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:31.936458 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:31.949312 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:45:32.102167 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:45:32.311840 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:45:32.617546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10259): Launched 01:45:32.883050 run iperf3-srv_10.42.42.10(pid=10260): Launched 01:45:32.999125 tst iperf3.py:8: start network... 01:45:33.202715 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:45:33.672800 run create_hlr_db(pid=10261): Launched 01:45:33.789869 bus /gobi_6: Setting Powered False 01:45:34.850566 run create_hlr_db(pid=10261): Terminated: ok {rc=0} 01:45:35.293514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10263): Launched 01:45:35.620340 run osmo-hlr_10.42.42.2(pid=10264): Launched 01:45:35.746273 run osmo-stp_10.42.42.5: Starting osmo-stp 01:45:36.310764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10266): Launched 01:45:36.636443 run osmo-stp_10.42.42.5(pid=10267): Launched 01:45:36.763382 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:45:37.323002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10269): Launched 01:45:37.449227 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:45:37.723748 run patchelf(pid=10270): Launched 01:45:37.903517 run osmo-stp_10.42.42.5(pid=10267): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10267)] 01:45:38.039760 run osmo-stp_10.42.42.5(pid=10267): stdout: | (launched: 2022-12-10_01:45:36.576818) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:45:38.178115 run osmo-stp_10.42.42.5(pid=10267): stderr: | 20221210014536770 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014536771 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014536771 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014536771 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014536772 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014536772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014536772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:45:38.316135 run osmo-stp_10.42.42.5(pid=10267): stdout: | (launched: 2022-12-10_01:45:36.576818) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:45:38.449343 run osmo-stp_10.42.42.5(pid=10267): stderr: | 20221210014536770 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014536771 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014536771 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014536771 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014536772 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014536772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014536772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:45:38.606372 run patchelf(pid=10270): Terminating (SIGINT) 01:45:38.786745 run patchelf(pid=10270): Terminated: ok {rc=0} 01:45:38.916738 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10267): Process ended prematurely: osmo-stp_10.42.42.5(pid=10267) [trial-2367↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10267)] [trial-2367↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 01:45:38.927011 tst iperf3.py:8: Test FAILED (7.7 sec) 01:45:38.955457 run osmo-hlr_10.42.42.2(pid=10264): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10264)] 01:45:39.004882 run osmo-hlr_10.42.42.2(pid=10264): stdout: | (launched: 2022-12-10_01:45:35.560838) 01:45:39.055892 run osmo-hlr_10.42.42.2(pid=10264): stderr: | 20221210014535760 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014535760 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014535760 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014535760 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014535760 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014535760 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014535772 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014535780 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014535780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014535780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:45:39.108237 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10259): Terminating (SIGTERM) 01:45:39.149822 run iperf3-srv_10.42.42.10(pid=10260): Terminating (SIGTERM) 01:45:39.191131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10263): Terminating (SIGTERM) 01:45:39.232498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10266): Terminating (SIGTERM) 01:45:39.273818 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10269): Terminating (SIGTERM) 01:45:39.315421 --- ParallelTerminationStrategy: PID 10259 died... 01:45:39.335063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10259): Terminated: ok {rc=0} 01:45:39.381468 --- ParallelTerminationStrategy: PID 10260 died... 01:45:39.401148 run iperf3-srv_10.42.42.10(pid=10260): Terminated {rc=256} 01:45:39.446949 --- ParallelTerminationStrategy: PID 10263 died... 01:45:39.466338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10263): Terminated: ok {rc=0} 01:45:39.511672 --- ParallelTerminationStrategy: PID 10266 died... 01:45:39.531079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10266): Terminated: ok {rc=0} 01:45:39.577025 --- ParallelTerminationStrategy: PID 10269 died... 01:45:39.596501 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10269): Terminated: ok {rc=0} 01:45:39.683680 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 01:45:40.834654 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:40.846907 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:45:40.910805 tst iperf3m4.py: using LAC 25129 01:45:41.030624 tst iperf3m4.py: using RAC 139 01:45:41.151843 tst iperf3m4.py: using CellId 25129 01:45:41.272015 tst iperf3m4.py: using BVCI 25130 01:45:41.382029 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:41.393203 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:41.404068 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:41.415989 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:41.427441 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:41.438965 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:41.450604 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:41.462164 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:41.473822 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:45:41.593793 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:45:41.712935 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:45:41.833496 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:45:41.953603 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:45:42.172228 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:45:42.498878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10271): Launched 01:45:42.781268 run iperf3-srv_10.42.42.10(pid=10272): Launched 01:45:42.905198 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:45:43.123782 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:45:43.450549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10273): Launched 01:45:43.734784 run iperf3-srv_10.42.42.10(pid=10274): Launched 01:45:43.856671 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:45:44.074489 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:45:44.400027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10275): Launched 01:45:44.682583 run iperf3-srv_10.42.42.10(pid=10276): Launched 01:45:44.805690 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:45:45.022737 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:45:45.348878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10277): Launched 01:45:45.631290 run iperf3-srv_10.42.42.10(pid=10278): Launched 01:45:45.754415 tst iperf3m4.py:8: start network... 01:45:45.989335 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:45:46.565380 run create_hlr_db(pid=10279): Launched 01:45:46.729359 bus /gobi_6: Setting Powered False 01:45:47.789389 run create_hlr_db(pid=10279): Terminated: ok {rc=0} 01:45:48.231911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10281): Launched 01:45:48.561386 run osmo-hlr_10.42.42.2(pid=10282): Launched 01:45:48.687623 run osmo-stp_10.42.42.5: Starting osmo-stp 01:45:49.253494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10284): Launched 01:45:49.581306 run osmo-stp_10.42.42.5(pid=10285): Launched 01:45:49.706298 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:45:50.265335 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10287): Launched 01:45:50.389156 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:45:50.663279 run patchelf(pid=10288): Launched 01:45:50.843736 run osmo-stp_10.42.42.5(pid=10285): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10285)] 01:45:50.979654 run osmo-stp_10.42.42.5(pid=10285): stdout: | (launched: 2022-12-10_01:45:49.521365) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:45:51.117620 run osmo-stp_10.42.42.5(pid=10285): stderr: | 20221210014549715 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014549715 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014549715 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014549716 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014549716 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014549716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014549716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:45:51.256123 run osmo-stp_10.42.42.5(pid=10285): stdout: | (launched: 2022-12-10_01:45:49.521365) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:45:51.388215 run osmo-stp_10.42.42.5(pid=10285): stderr: | 20221210014549715 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014549715 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014549715 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014549716 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014549716 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014549716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014549716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:45:51.545559 run patchelf(pid=10288): Terminating (SIGINT) 01:45:51.725680 run patchelf(pid=10288): Terminated: ok {rc=0} 01:45:51.855005 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10285): Process ended prematurely: osmo-stp_10.42.42.5(pid=10285) [trial-2367↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10285)] [trial-2367↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 01:45:51.865190 tst iperf3m4.py:8: Test FAILED (11.1 sec) 01:45:51.894194 run osmo-hlr_10.42.42.2(pid=10282): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10282)] 01:45:51.944197 run osmo-hlr_10.42.42.2(pid=10282): stdout: | (launched: 2022-12-10_01:45:48.500342) 01:45:51.996045 run osmo-hlr_10.42.42.2(pid=10282): stderr: | 20221210014548701 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014548701 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014548701 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014548701 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014548701 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014548701 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014548716 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014548724 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014548725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014548725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:45:52.048032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10271): Terminating (SIGTERM) 01:45:52.089983 run iperf3-srv_10.42.42.10(pid=10272): Terminating (SIGTERM) 01:45:52.131722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10273): Terminating (SIGTERM) 01:45:52.173648 run iperf3-srv_10.42.42.10(pid=10274): Terminating (SIGTERM) 01:45:52.215312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10275): Terminating (SIGTERM) 01:45:52.257073 run iperf3-srv_10.42.42.10(pid=10276): Terminating (SIGTERM) 01:45:52.298606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10277): Terminating (SIGTERM) 01:45:52.340436 run iperf3-srv_10.42.42.10(pid=10278): Terminating (SIGTERM) 01:45:52.381998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10281): Terminating (SIGTERM) 01:45:52.424144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10284): Terminating (SIGTERM) 01:45:52.466005 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10287): Terminating (SIGTERM) 01:45:52.508003 --- ParallelTerminationStrategy: PID 10271 died... 01:45:52.527947 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10271): Terminated: ok {rc=0} 01:45:52.574838 --- ParallelTerminationStrategy: PID 10272 died... 01:45:52.594367 run iperf3-srv_10.42.42.10(pid=10272): Terminated {rc=256} 01:45:52.640512 --- ParallelTerminationStrategy: PID 10273 died... 01:45:52.659998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10273): Terminated: ok {rc=0} 01:45:52.705779 --- ParallelTerminationStrategy: PID 10274 died... 01:45:52.725318 run iperf3-srv_10.42.42.10(pid=10274): Terminated {rc=256} 01:45:52.770796 --- ParallelTerminationStrategy: PID 10275 died... 01:45:52.790142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10275): Terminated: ok {rc=0} 01:45:52.836596 --- ParallelTerminationStrategy: PID 10276 died... 01:45:52.856150 run iperf3-srv_10.42.42.10(pid=10276): Terminated {rc=256} 01:45:52.901456 --- ParallelTerminationStrategy: PID 10277 died... 01:45:52.920682 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10277): Terminated: ok {rc=0} 01:45:52.966916 --- ParallelTerminationStrategy: PID 10278 died... 01:45:52.986401 run iperf3-srv_10.42.42.10(pid=10278): Terminated {rc=256} 01:45:53.031742 --- ParallelTerminationStrategy: PID 10281 died... 01:45:53.051159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10281): Terminated: ok {rc=0} 01:45:53.096826 --- ParallelTerminationStrategy: PID 10284 died... 01:45:53.116374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10284): Terminated: ok {rc=0} 01:45:53.161918 --- ParallelTerminationStrategy: PID 10287 died... 01:45:53.181451 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10287): Terminated: ok {rc=0} 01:45:53.269127 bus /gobi_4: Setting Powered False 01:45:54.367513 bus /gobi_4: Setting Powered False 01:45:55.482610 bus /gobi_1: Setting Powered False 01:45:56.581611 bus /gobi_1: Setting Powered False 01:45:57.697343 bus /gobi_0: Setting Powered False 01:45:58.795166 bus /gobi_0: Setting Powered False 01:45:59.911153 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 01:46:01.040592 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:01.053766 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:46:01.117316 tst ping.py: using LAC 25130 01:46:01.237992 tst ping.py: using RAC 140 01:46:01.369782 tst ping.py: using CellId 25130 01:46:01.505053 tst ping.py: using BVCI 25131 01:46:01.656500 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:01.672043 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:01.687330 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:01.703092 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:01.718323 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:01.732809 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:01.748463 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:01.764097 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:46:01.887359 tst ping.py:19: start network... 01:46:02.163542 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:46:02.639596 run create_hlr_db(pid=10289): Launched 01:46:02.755001 bus /gobi_6: Setting Powered False 01:46:03.814505 run create_hlr_db(pid=10289): Terminated: ok {rc=0} 01:46:04.229798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10291): Launched 01:46:04.529672 run osmo-hlr_10.42.42.2(pid=10292): Launched 01:46:04.644887 run osmo-stp_10.42.42.5: Starting osmo-stp 01:46:05.174737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10294): Launched 01:46:05.475982 run osmo-stp_10.42.42.5(pid=10295): Launched 01:46:05.590397 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:46:06.107802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10297): Launched 01:46:06.222650 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:46:06.475269 run patchelf(pid=10298): Launched 01:46:06.643625 run osmo-stp_10.42.42.5(pid=10295): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10295)] 01:46:06.769962 run osmo-stp_10.42.42.5(pid=10295): stdout: | (launched: 2022-12-10_01:46:05.420312) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:46:06.898145 run osmo-stp_10.42.42.5(pid=10295): stderr: | 20221210014605591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014605592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014605592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014605592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014605593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014605593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014605593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:46:07.026131 run osmo-stp_10.42.42.5(pid=10295): stdout: | (launched: 2022-12-10_01:46:05.420312) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:46:07.149222 run osmo-stp_10.42.42.5(pid=10295): stderr: | 20221210014605591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014605592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014605592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014605592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014605593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014605593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014605593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:46:07.294395 run patchelf(pid=10298): Terminating (SIGINT) 01:46:07.461855 run patchelf(pid=10298): Terminated: ok {rc=0} 01:46:07.582159 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10295): Process ended prematurely: osmo-stp_10.42.42.5(pid=10295) [trial-2367↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10295)] [trial-2367↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 01:46:07.591138 tst ping.py:22: Test FAILED (6.5 sec) 01:46:07.618176 run osmo-hlr_10.42.42.2(pid=10292): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10292)] 01:46:07.665686 run osmo-hlr_10.42.42.2(pid=10292): stdout: | (launched: 2022-12-10_01:46:04.473970) 01:46:07.714829 run osmo-hlr_10.42.42.2(pid=10292): stderr: | 20221210014604650 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014604650 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014604650 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014604650 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014604650 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014604650 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014604662 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014604672 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014604672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014604672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:46:07.763995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10291): Terminating (SIGTERM) 01:46:07.803737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10294): Terminating (SIGTERM) 01:46:07.843515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10297): Terminating (SIGTERM) 01:46:07.883743 --- ParallelTerminationStrategy: PID 10291 died... 01:46:07.902331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10291): Terminated: ok {rc=0} 01:46:07.946443 --- ParallelTerminationStrategy: PID 10294 died... 01:46:07.965140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10294): Terminated: ok {rc=0} 01:46:08.009260 --- ParallelTerminationStrategy: PID 10297 died... 01:46:08.027759 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10297): Terminated: ok {rc=0} 01:46:08.111270 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 01:46:09.198013 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:09.210821 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:46:09.273786 tst ping_idle_ping.py: using LAC 25131 01:46:09.400797 tst ping_idle_ping.py: using RAC 141 01:46:09.526276 tst ping_idle_ping.py: using CellId 25131 01:46:09.651247 tst ping_idle_ping.py: using BVCI 25132 01:46:09.767199 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:09.778700 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:09.790004 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:09.801220 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:09.812420 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:09.823754 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:09.835189 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:09.846500 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:46:09.964589 tst ping_idle_ping.py:24: start network... 01:46:10.178959 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:46:10.675441 run create_hlr_db(pid=10299): Launched 01:46:10.805281 bus /gobi_6: Setting Powered False 01:46:11.868234 run create_hlr_db(pid=10299): Terminated: ok {rc=0} 01:46:12.311686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10301): Launched 01:46:12.632936 run osmo-hlr_10.42.42.2(pid=10302): Launched 01:46:12.758528 run osmo-stp_10.42.42.5: Starting osmo-stp 01:46:13.305617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10304): Launched 01:46:13.627986 run osmo-stp_10.42.42.5(pid=10305): Launched 01:46:13.753484 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:46:14.304701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10307): Launched 01:46:14.427201 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:46:14.697716 run patchelf(pid=10308): Launched 01:46:14.876379 run osmo-stp_10.42.42.5(pid=10305): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10305)] 01:46:15.011514 run osmo-stp_10.42.42.5(pid=10305): stdout: | (launched: 2022-12-10_01:46:13.568850) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:46:15.148200 run osmo-stp_10.42.42.5(pid=10305): stderr: | 20221210014613760 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014613761 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014613761 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014613762 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014613764 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014613764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014613764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:46:15.284732 run osmo-stp_10.42.42.5(pid=10305): stdout: | (launched: 2022-12-10_01:46:13.568850) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:46:15.417547 run osmo-stp_10.42.42.5(pid=10305): stderr: | 20221210014613760 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014613761 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014613761 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014613762 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014613764 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014613764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014613764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:46:15.573640 run patchelf(pid=10308): Terminating (SIGINT) 01:46:15.752438 run patchelf(pid=10308): Terminated: ok {rc=0} 01:46:15.903776 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10305): Process ended prematurely: osmo-stp_10.42.42.5(pid=10305) [trial-2367↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10305)] [trial-2367↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 01:46:15.914029 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 01:46:15.945908 run osmo-hlr_10.42.42.2(pid=10302): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10302)] 01:46:15.996693 run osmo-hlr_10.42.42.2(pid=10302): stdout: | (launched: 2022-12-10_01:46:12.574214) 01:46:16.049485 run osmo-hlr_10.42.42.2(pid=10302): stderr: | 20221210014612772 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014612772 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014612772 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014612772 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014612772 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014612772 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014612785 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014612794 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014612794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014612794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:46:16.103006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10301): Terminating (SIGTERM) 01:46:16.146145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10304): Terminating (SIGTERM) 01:46:16.190288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10307): Terminating (SIGTERM) 01:46:16.233331 --- ParallelTerminationStrategy: PID 10301 died... 01:46:16.253678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10301): Terminated: ok {rc=0} 01:46:16.300863 --- ParallelTerminationStrategy: PID 10304 died... 01:46:16.321210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10304): Terminated: ok {rc=0} 01:46:16.368526 --- ParallelTerminationStrategy: PID 10307 died... 01:46:16.388814 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10307): Terminated: ok {rc=0} 01:46:16.482950 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 01:46:17.794527 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:46:17.802616 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:46:17.826913 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 01:46:17.862061 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:46:17.916073 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:46:17.940306 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 01:46:17.975181 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:46:18.534998 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2367 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 01:46:18.540565 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:46:18.552308 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:46:18.614259 tst switch_tch_pdch.py: using LAC 25132 01:46:18.731767 tst switch_tch_pdch.py: using RAC 142 01:46:18.850722 tst switch_tch_pdch.py: using CellId 25132 01:46:18.969293 tst switch_tch_pdch.py: using BVCI 25133 01:46:19.080087 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:46:19.091678 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:46:19.103158 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:46:19.115373 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:46:19.127592 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:46:19.140389 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:46:19.151950 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:46:19.164179 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:46:19.285705 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:46:19.407471 tst switch_tch_pdch.py:51: start network... 01:46:19.622829 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:46:20.118332 run create_hlr_db(pid=10312): Launched 01:46:20.249260 bus /gobi_6: Setting Powered False 01:46:21.312547 run create_hlr_db(pid=10312): Terminated: ok {rc=0} 01:46:21.739877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10315): Launched 01:46:22.040559 run osmo-hlr_10.42.42.2(pid=10316): Launched 01:46:22.155584 run osmo-stp_10.42.42.5: Starting osmo-stp 01:46:22.685722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10318): Launched 01:46:22.985524 run osmo-stp_10.42.42.5(pid=10319): Launched 01:46:23.100212 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:46:23.617684 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10321): Launched 01:46:23.732840 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:46:23.986624 run patchelf(pid=10322): Launched 01:46:24.155108 run osmo-stp_10.42.42.5(pid=10319): ERR: Terminated: ERROR {rc=1} [trial-2367↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10319)] 01:46:24.281680 run osmo-stp_10.42.42.5(pid=10319): stdout: | (launched: 2022-12-10_01:46:22.929892) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:46:24.409446 run osmo-stp_10.42.42.5(pid=10319): stderr: | 20221210014623100 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014623100 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014623100 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014623101 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014623101 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014623101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014623101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:46:24.537608 run osmo-stp_10.42.42.5(pid=10319): stdout: | (launched: 2022-12-10_01:46:22.929892) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:46:24.660100 run osmo-stp_10.42.42.5(pid=10319): stderr: | 20221210014623100 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014623100 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014623100 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014623101 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014623101 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014623101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014623101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:46:24.805406 run patchelf(pid=10322): Terminating (SIGINT) 01:46:24.972003 run patchelf(pid=10322): Terminated: ok {rc=0} 01:46:25.091844 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=10319): Process ended prematurely: osmo-stp_10.42.42.5(pid=10319) [trial-2367↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10319)] [trial-2367↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 01:46:25.100905 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 01:46:25.127924 run osmo-hlr_10.42.42.2(pid=10316): ERR: Terminated: ERROR {rc=237} [trial-2367↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10316)] 01:46:25.175868 run osmo-hlr_10.42.42.2(pid=10316): stdout: | (launched: 2022-12-10_01:46:21.985095) 01:46:25.225313 run osmo-hlr_10.42.42.2(pid=10316): stderr: | 20221210014622163 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014622163 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014622163 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014622163 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014622163 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014622163 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014622177 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014622187 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014622187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014622187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:46:25.274928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10315): Terminating (SIGTERM) 01:46:25.314654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10318): Terminating (SIGTERM) 01:46:25.354500 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10321): Terminating (SIGTERM) 01:46:25.394509 --- ParallelTerminationStrategy: PID 10315 died... 01:46:25.413528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10315): Terminated: ok {rc=0} 01:46:25.457972 --- ParallelTerminationStrategy: PID 10318 died... 01:46:25.476523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10318): Terminated: ok {rc=0} 01:46:25.520888 --- ParallelTerminationStrategy: PID 10321 died... 01:46:25.539685 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10321): Terminated: ok {rc=0} 01:46:25.622877 bus /gobi_0: Setting Powered False 01:46:26.720082 bus /gobi_0: Setting Powered False 01:46:27.836874 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 sms:nanobts+band-900 --------------------------------------------------------------------- 01:46:29.086921 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:46:29.091763 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 01:46:29.124924 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 01:46:29.150970 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 01:46:29.202500 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 01:46:29.235754 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 01:46:29.262917 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 01:46:29.811110 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 01:46:29.816586 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:46:29.827918 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 01:46:29.880004 tst mo_mt_sms.py: using LAC 25133 01:46:30.005042 tst mo_mt_sms.py: using RAC 143 01:46:30.128345 tst mo_mt_sms.py: using CellId 25133 01:46:30.252354 tst mo_mt_sms.py: using BVCI 25134 01:46:30.367758 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:46:30.378887 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:46:30.389936 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:46:30.401107 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:46:30.412216 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:46:30.423585 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 01:46:30.537673 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 01:46:30.656864 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:46:31.148855 run create_hlr_db(pid=10326): Launched 01:46:31.319363 bus /gobi_6: Setting Powered False 01:46:32.380635 run create_hlr_db(pid=10326): Terminated: ok {rc=0} 01:46:32.810342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10328): Launched 01:46:33.133120 run osmo-hlr_10.42.42.2(pid=10329): Launched 01:46:33.256336 run osmo-stp_10.42.42.5: Starting osmo-stp 01:46:33.806509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10331): Launched 01:46:34.125657 run osmo-stp_10.42.42.5(pid=10332): Launched 01:46:34.247685 run osmo-msc_10.42.42.6: Starting osmo-msc 01:46:34.828507 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10334): Launched 01:46:35.148817 run osmo-msc_10.42.42.6(pid=10335): Launched 01:46:35.326714 run osmo-stp_10.42.42.5(pid=10332): ERR: Terminated: ERROR {rc=1} [trial-2367↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10332)] 01:46:35.461341 run osmo-stp_10.42.42.5(pid=10332): stdout: | (launched: 2022-12-10_01:46:34.066590) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:46:35.596168 run osmo-stp_10.42.42.5(pid=10332): stderr: | 20221210014634260 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014634260 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014634260 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014634261 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014634261 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014634261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014634261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:46:35.729984 run osmo-stp_10.42.42.5(pid=10332): stdout: | (launched: 2022-12-10_01:46:34.066590) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:46:35.856732 run osmo-stp_10.42.42.5(pid=10332): stderr: | 20221210014634260 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014634260 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014634260 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014634261 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014634261 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014634261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014634261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:46:36.008510 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=10332): Process ended prematurely: osmo-stp_10.42.42.5(pid=10332) [trial-2367↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10332)] [trial-2367↪sms:nanobts+band-900↪mo_mt_sms.py:16] 01:46:36.017697 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 01:46:36.045784 run osmo-hlr_10.42.42.2(pid=10329): ERR: Terminated: ERROR {rc=237} [trial-2367↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10329)] 01:46:36.095695 run osmo-hlr_10.42.42.2(pid=10329): stdout: | (launched: 2022-12-10_01:46:33.074218) 01:46:36.147525 run osmo-hlr_10.42.42.2(pid=10329): stderr: | 20221210014633272 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014633272 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014633272 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014633272 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014633272 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014633272 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014633284 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014633293 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014633293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014633293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:46:36.219349 run osmo-msc_10.42.42.6(pid=10335): ERR: Terminated: ERROR {rc=2} [trial-2367↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10335)] 01:46:36.269577 run osmo-msc_10.42.42.6(pid=10335): stdout: | (launched: 2022-12-10_01:46:35.089239) 01:46:36.320940 run osmo-msc_10.42.42.6(pid=10335): stderr: | 20221210014635412 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210014635412 DLGLOBAL DEBUG validating counter group 0x7fee170ddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210014635412 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210014635413 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210014635413 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210014635413 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210014635415 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210014635415 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210014635415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210014635415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:46:36.372831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10328): Terminating (SIGTERM) 01:46:36.414678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10331): Terminating (SIGTERM) 01:46:36.457639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10334): Terminating (SIGTERM) 01:46:36.500151 --- ParallelTerminationStrategy: PID 10328 died... 01:46:36.520188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10328): Terminated: ok {rc=0} 01:46:36.566468 --- ParallelTerminationStrategy: PID 10331 died... 01:46:36.586031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10331): Terminated: ok {rc=0} 01:46:36.631962 --- ParallelTerminationStrategy: PID 10334 died... 01:46:36.651557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10334): Terminated: ok {rc=0} 01:46:36.738399 bus /sierra_3: Setting Powered False 01:46:37.837509 bus /sierra_3: Setting Powered False 01:46:38.953921 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 01:46:40.186651 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:46:40.192797 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 01:46:40.227094 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 01:46:40.234343 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 01:46:40.270536 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 01:46:40.303571 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 01:46:40.310682 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 01:46:40.830893 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2367 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 01:46:40.836315 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 01:46:40.847977 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 01:46:40.897485 tst assert_extension.py: using LAC 25134 01:46:41.022501 tst assert_extension.py: using RAC 144 01:46:41.148797 tst assert_extension.py: using CellId 25134 01:46:41.275081 tst assert_extension.py: using BVCI 25135 01:46:41.390570 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 01:46:41.507655 tst assert_extension.py:10: start nitb and bts... 01:46:41.722254 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:46:42.372716 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10340): Launched 01:46:42.691989 run osmo-nitb_10.42.42.2(pid=10341): Launched 01:46:42.870219 run osmo-nitb_10.42.42.2(pid=10341): ERR: Terminated: ERROR {rc=2} [trial-2367↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10341)] 01:46:43.012661 run osmo-nitb_10.42.42.2(pid=10341): stdout: | (launched: 2022-12-10_01:46:42.633456) 01:46:43.156513 run osmo-nitb_10.42.42.2(pid=10341): stderr: | (launched: 2022-12-10_01:46:42.680795) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:46:43.300277 run osmo-nitb_10.42.42.2(pid=10341): stdout: | (launched: 2022-12-10_01:46:42.633456) 01:46:43.439252 run osmo-nitb_10.42.42.2(pid=10341): stderr: | (launched: 2022-12-10_01:46:42.680795) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=10341): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10341) [trial-2367↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10341)] 01:46:43.813896 tst osmo-nitb_10.42.42.2(pid=10341): stdout: | (launched: 2022-12-10_01:46:42.633456) 01:46:43.943523 tst osmo-nitb_10.42.42.2(pid=10341): stderr: | (launched: 2022-12-10_01:46:42.680795) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:46:44.096398 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=10341): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10341) [trial-2367↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10341)] [trial-2367↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 01:46:44.105469 tst assert_extension.py:12: Test FAILED (3.3 sec) 01:46:44.112422 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10340): Terminating (SIGTERM) 01:46:44.324270 --- ParallelTerminationStrategy: PID 10340 died... 01:46:44.345882 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10340): Terminated: ok {rc=0} 01:46:44.433863 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 ussd:nanobts+band-900 --------------------------------------------------------------------- 01:46:45.615081 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:46:45.620919 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 01:46:45.654281 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 01:46:45.681105 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 01:46:45.716552 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 01:46:45.748767 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 01:46:45.775409 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 01:46:46.330530 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2367 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 01:46:46.339414 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:46:46.355385 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 01:46:46.415850 tst assert_extension.py: using LAC 25135 01:46:46.577515 tst assert_extension.py: using RAC 145 01:46:46.698564 tst assert_extension.py: using CellId 25135 01:46:46.825673 tst assert_extension.py: using BVCI 25136 01:46:46.949213 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:46:46.961378 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:46:46.973388 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:46:46.985565 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:46:46.997724 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:46:47.009383 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 01:46:47.124854 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:46:47.594275 run create_hlr_db(pid=10345): Launched 01:46:47.709468 bus /sierra_2: Setting Powered False 01:46:48.768281 run create_hlr_db(pid=10345): Terminated: ok {rc=0} 01:46:49.207449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10347): Launched 01:46:49.528400 run osmo-hlr_10.42.42.2(pid=10348): Launched 01:46:49.653238 run osmo-stp_10.42.42.5: Starting osmo-stp 01:46:50.207510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10350): Launched 01:46:50.528182 run osmo-stp_10.42.42.5(pid=10351): Launched 01:46:50.651409 run osmo-msc_10.42.42.6: Starting osmo-msc 01:46:51.231216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10353): Launched 01:46:51.551407 run osmo-msc_10.42.42.6(pid=10354): Launched 01:46:51.734221 run osmo-stp_10.42.42.5(pid=10351): ERR: Terminated: ERROR {rc=1} [trial-2367↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10351)] 01:46:51.868536 run osmo-stp_10.42.42.5(pid=10351): stdout: | (launched: 2022-12-10_01:46:50.469344) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:46:52.003236 run osmo-stp_10.42.42.5(pid=10351): stderr: | 20221210014650663 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014650663 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014650664 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014650664 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014650664 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014650664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014650665 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:46:52.136688 run osmo-stp_10.42.42.5(pid=10351): stdout: | (launched: 2022-12-10_01:46:50.469344) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:46:52.263581 run osmo-stp_10.42.42.5(pid=10351): stderr: | 20221210014650663 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014650663 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014650664 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014650664 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014650664 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014650664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014650665 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:46:52.414821 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=10351): Process ended prematurely: osmo-stp_10.42.42.5(pid=10351) [trial-2367↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10351)] [trial-2367↪ussd:nanobts+band-900↪assert_extension.py:17] 01:46:52.423826 tst assert_extension.py:17: Test FAILED (6.1 sec) 01:46:52.451913 run osmo-hlr_10.42.42.2(pid=10348): ERR: Terminated: ERROR {rc=237} [trial-2367↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10348)] 01:46:52.502190 run osmo-hlr_10.42.42.2(pid=10348): stdout: | (launched: 2022-12-10_01:46:49.469311) 01:46:52.554414 run osmo-hlr_10.42.42.2(pid=10348): stderr: | 20221210014649668 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014649668 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014649668 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014649668 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014649668 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014649668 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014649680 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014649689 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014649689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014649689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:46:52.627338 run osmo-msc_10.42.42.6(pid=10354): ERR: Terminated: ERROR {rc=2} [trial-2367↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10354)] 01:46:52.677570 run osmo-msc_10.42.42.6(pid=10354): stdout: | (launched: 2022-12-10_01:46:51.492655) 01:46:52.729339 run osmo-msc_10.42.42.6(pid=10354): stderr: | 20221210014651814 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210014651814 DLGLOBAL DEBUG validating counter group 0x7f87c0c07c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210014651815 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210014651815 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210014651815 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210014651815 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210014651817 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210014651817 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210014651817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210014651817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:46:52.781658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10347): Terminating (SIGTERM) 01:46:52.823506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10350): Terminating (SIGTERM) 01:46:52.865389 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10353): Terminating (SIGTERM) 01:46:52.907460 --- ParallelTerminationStrategy: PID 10347 died... 01:46:52.927508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10347): Terminated: ok {rc=0} 01:46:52.974616 --- ParallelTerminationStrategy: PID 10350 died... 01:46:52.994273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10350): Terminated: ok {rc=0} 01:46:53.040203 --- ParallelTerminationStrategy: PID 10353 died... 01:46:53.059766 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10353): Terminated: ok {rc=0} 01:46:53.147335 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 01:46:54.356770 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:46:54.364271 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 01:46:54.397607 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 01:46:54.423996 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 01:46:54.479018 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 01:46:54.512386 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 01:46:54.539608 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 01:46:55.090849 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 01:46:55.143215 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:46:55.154887 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:46:55.222888 tst mo_mt_call.py: using LAC 25136 01:46:55.349421 tst mo_mt_call.py: using RAC 146 01:46:55.468831 tst mo_mt_call.py: using CellId 25136 01:46:55.588690 tst mo_mt_call.py: using BVCI 25137 01:46:55.700845 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:46:55.712431 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:46:55.723654 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:46:55.735445 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:46:55.747229 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:46:55.758945 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:46:55.880575 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:46:55.996870 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:46:56.469252 run create_hlr_db(pid=10359): Launched 01:46:56.586739 bus /sierra_2: Setting Powered False 01:46:57.647310 run create_hlr_db(pid=10359): Terminated: ok {rc=0} 01:46:58.075225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10361): Launched 01:46:58.381479 run osmo-hlr_10.42.42.2(pid=10362): Launched 01:46:58.499191 run osmo-stp_10.42.42.5: Starting osmo-stp 01:46:59.036905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10364): Launched 01:46:59.343223 run osmo-stp_10.42.42.5(pid=10365): Launched 01:46:59.460035 run osmo-msc_10.42.42.6: Starting osmo-msc 01:47:00.011186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10367): Launched 01:47:00.317497 run osmo-msc_10.42.42.6(pid=10368): Launched 01:47:00.489094 run osmo-stp_10.42.42.5(pid=10365): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10365)] 01:47:00.618738 run osmo-stp_10.42.42.5(pid=10365): stdout: | (launched: 2022-12-10_01:46:59.286105) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:00.747666 run osmo-stp_10.42.42.5(pid=10365): stderr: | 20221210014659460 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014659460 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014659460 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014659461 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014659461 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014659461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014659461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:00.875836 run osmo-stp_10.42.42.5(pid=10365): stdout: | (launched: 2022-12-10_01:46:59.286105) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:00.999798 run osmo-stp_10.42.42.5(pid=10365): stderr: | 20221210014659460 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014659460 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014659460 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014659461 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014659461 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014659461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014659461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:01.147824 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10365): Process ended prematurely: osmo-stp_10.42.42.5(pid=10365) [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10365)] [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 01:47:01.157457 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:47:01.185790 run osmo-hlr_10.42.42.2(pid=10362): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10362)] 01:47:01.234983 run osmo-hlr_10.42.42.2(pid=10362): stdout: | (launched: 2022-12-10_01:46:58.324783) 01:47:01.285805 run osmo-hlr_10.42.42.2(pid=10362): stderr: | 20221210014658501 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014658501 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014658501 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014658501 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014658501 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014658501 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014658513 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014658522 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014658522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014658522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:47:01.357217 run osmo-msc_10.42.42.6(pid=10368): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10368)] 01:47:01.406660 run osmo-msc_10.42.42.6(pid=10368): stdout: | (launched: 2022-12-10_01:47:00.260378) 01:47:01.457681 run osmo-msc_10.42.42.6(pid=10368): stderr: | 20221210014700533 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210014700533 DLGLOBAL DEBUG validating counter group 0x7ff6f7486c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210014700533 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210014700533 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210014700533 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210014700533 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210014700537 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210014700537 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210014700537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210014700538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:47:01.509291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10361): Terminating (SIGTERM) 01:47:01.556080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10364): Terminating (SIGTERM) 01:47:01.612823 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10367): Terminating (SIGTERM) 01:47:01.673465 --- ParallelTerminationStrategy: PID 10361 died... 01:47:01.699563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10361): Terminated: ok {rc=0} 01:47:01.767149 --- ParallelTerminationStrategy: PID 10364 died... 01:47:01.790157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10364): Terminated: ok {rc=0} 01:47:01.853457 --- ParallelTerminationStrategy: PID 10367 died... 01:47:01.880085 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10367): Terminated: ok {rc=0} 01:47:01.968923 bus /sierra_3: Setting Powered False 01:47:03.065308 bus /sierra_3: Setting Powered False 01:47:04.180360 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 01:47:05.327848 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:47:05.339970 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:47:05.408615 tst mo_mt_call_osmux.py: using LAC 25137 01:47:05.527478 tst mo_mt_call_osmux.py: using RAC 147 01:47:05.648470 tst mo_mt_call_osmux.py: using CellId 25137 01:47:05.768891 tst mo_mt_call_osmux.py: using BVCI 25138 01:47:05.881744 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:47:05.892829 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:47:05.903843 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:47:05.915634 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:47:05.927557 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:47:05.939153 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:47:06.054874 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:47:06.170553 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:47:06.642220 run create_hlr_db(pid=10370): Launched 01:47:06.760246 bus /sierra_2: Setting Powered False 01:47:07.821500 run create_hlr_db(pid=10370): Terminated: ok {rc=0} 01:47:08.264331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10372): Launched 01:47:08.590802 run osmo-hlr_10.42.42.2(pid=10373): Launched 01:47:08.719082 run osmo-stp_10.42.42.5: Starting osmo-stp 01:47:09.276787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10375): Launched 01:47:09.604789 run osmo-stp_10.42.42.5(pid=10376): Launched 01:47:09.731751 run osmo-msc_10.42.42.6: Starting osmo-msc 01:47:10.318273 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10378): Launched 01:47:10.645419 run osmo-msc_10.42.42.6(pid=10379): Launched 01:47:10.829906 run osmo-stp_10.42.42.5(pid=10376): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10376)] 01:47:10.966541 run osmo-stp_10.42.42.5(pid=10376): stdout: | (launched: 2022-12-10_01:47:09.544516) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:11.104107 run osmo-stp_10.42.42.5(pid=10376): stderr: | 20221210014709738 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014709738 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014709738 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014709739 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014709739 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014709739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014709739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:11.239830 run osmo-stp_10.42.42.5(pid=10376): stdout: | (launched: 2022-12-10_01:47:09.544516) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:11.369257 run osmo-stp_10.42.42.5(pid=10376): stderr: | 20221210014709738 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014709738 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014709738 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014709739 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014709739 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014709739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014709739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:11.524691 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10376): Process ended prematurely: osmo-stp_10.42.42.5(pid=10376) [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10376)] [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 01:47:11.534464 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 01:47:11.562361 run osmo-hlr_10.42.42.2(pid=10373): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10373)] 01:47:11.612025 run osmo-hlr_10.42.42.2(pid=10373): stdout: | (launched: 2022-12-10_01:47:08.531241) 01:47:11.663492 run osmo-hlr_10.42.42.2(pid=10373): stderr: | 20221210014708730 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014708730 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014708730 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014708730 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014708730 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014708730 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014708742 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014708751 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014708751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014708751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:47:11.734982 run osmo-msc_10.42.42.6(pid=10379): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10379)] 01:47:11.784295 run osmo-msc_10.42.42.6(pid=10379): stdout: | (launched: 2022-12-10_01:47:10.585128) 01:47:11.835747 run osmo-msc_10.42.42.6(pid=10379): stderr: | 20221210014710908 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210014710908 DLGLOBAL DEBUG validating counter group 0x7f92df85fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210014710908 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210014710908 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210014710908 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210014710908 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210014710910 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210014710910 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210014710911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210014710911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:47:11.887413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10372): Terminating (SIGTERM) 01:47:11.928841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10375): Terminating (SIGTERM) 01:47:11.970203 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10378): Terminating (SIGTERM) 01:47:12.011848 --- ParallelTerminationStrategy: PID 10372 died... 01:47:12.031858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10372): Terminated: ok {rc=0} 01:47:12.078374 --- ParallelTerminationStrategy: PID 10375 died... 01:47:12.098044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10375): Terminated: ok {rc=0} 01:47:12.143882 --- ParallelTerminationStrategy: PID 10378 died... 01:47:12.163507 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10378): Terminated: ok {rc=0} 01:47:12.250075 bus /sierra_3: Setting Powered False 01:47:13.348186 bus /sierra_3: Setting Powered False 01:47:14.462956 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 01:47:15.722691 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:47:15.730779 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 01:47:15.763777 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 01:47:15.790765 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 01:47:15.860941 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 01:47:15.911594 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 01:47:15.940774 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 01:47:16.471527 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 01:47:16.524798 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:47:16.536931 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:47:16.602675 tst mo_mt_call.py: using LAC 25138 01:47:16.725354 tst mo_mt_call.py: using RAC 148 01:47:16.851574 tst mo_mt_call.py: using CellId 25138 01:47:16.981399 tst mo_mt_call.py: using BVCI 25139 01:47:17.100917 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:47:17.113158 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:47:17.125088 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:47:17.137149 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:47:17.149134 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:47:17.160844 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:47:17.287644 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:47:17.413628 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:47:17.918989 run create_hlr_db(pid=10390): Launched 01:47:18.050980 bus /sierra_2: Setting Powered False 01:47:19.115578 run create_hlr_db(pid=10390): Terminated: ok {rc=0} 01:47:19.550019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10392): Launched 01:47:19.855784 run osmo-hlr_10.42.42.2(pid=10393): Launched 01:47:19.972338 run osmo-stp_10.42.42.5: Starting osmo-stp 01:47:20.495310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10395): Launched 01:47:20.800186 run osmo-stp_10.42.42.5(pid=10396): Launched 01:47:20.916432 run osmo-msc_10.42.42.6: Starting osmo-msc 01:47:21.466248 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10398): Launched 01:47:21.771202 run osmo-msc_10.42.42.6(pid=10399): Launched 01:47:21.942349 run osmo-stp_10.42.42.5(pid=10396): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10396)] 01:47:22.070909 run osmo-stp_10.42.42.5(pid=10396): stdout: | (launched: 2022-12-10_01:47:20.743406) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:22.199330 run osmo-stp_10.42.42.5(pid=10396): stderr: | 20221210014720916 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014720917 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014720917 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014720917 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014720918 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014720918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014720918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:22.325717 run osmo-stp_10.42.42.5(pid=10396): stdout: | (launched: 2022-12-10_01:47:20.743406) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:22.446233 run osmo-stp_10.42.42.5(pid=10396): stderr: | 20221210014720916 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014720917 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014720917 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014720917 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014720918 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014720918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014720918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:22.591135 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10396): Process ended prematurely: osmo-stp_10.42.42.5(pid=10396) [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10396)] [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 01:47:22.599980 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:47:22.626700 run osmo-hlr_10.42.42.2(pid=10393): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10393)] 01:47:22.674566 run osmo-hlr_10.42.42.2(pid=10393): stdout: | (launched: 2022-12-10_01:47:19.799172) 01:47:22.723809 run osmo-hlr_10.42.42.2(pid=10393): stderr: | 20221210014719977 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014719977 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014719977 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014719977 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014719977 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014719977 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014719990 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014719999 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014719999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014720000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:47:22.792406 run osmo-msc_10.42.42.6(pid=10399): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10399)] 01:47:22.840046 run osmo-msc_10.42.42.6(pid=10399): stdout: | (launched: 2022-12-10_01:47:21.714816) 01:47:22.889064 run osmo-msc_10.42.42.6(pid=10399): stderr: | 20221210014721991 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210014721991 DLGLOBAL DEBUG validating counter group 0x7f79312f8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210014721991 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210014721991 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210014721991 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210014721991 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210014721993 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210014721994 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210014721994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210014721994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:47:22.938425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10392): Terminating (SIGTERM) 01:47:22.978077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10395): Terminating (SIGTERM) 01:47:23.017744 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10398): Terminating (SIGTERM) 01:47:23.057553 --- ParallelTerminationStrategy: PID 10392 died... 01:47:23.076493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10392): Terminated: ok {rc=0} 01:47:23.121075 --- ParallelTerminationStrategy: PID 10395 died... 01:47:23.139463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10395): Terminated: ok {rc=0} 01:47:23.183511 --- ParallelTerminationStrategy: PID 10398 died... 01:47:23.202163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10398): Terminated: ok {rc=0} 01:47:23.288032 bus /sierra_3: Setting Powered False 01:47:24.388465 bus /sierra_3: Setting Powered False 01:47:25.504454 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 01:47:26.649756 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:47:26.661914 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:47:26.728775 tst mo_mt_call_osmux.py: using LAC 25139 01:47:26.846819 tst mo_mt_call_osmux.py: using RAC 149 01:47:26.966591 tst mo_mt_call_osmux.py: using CellId 25139 01:47:27.086957 tst mo_mt_call_osmux.py: using BVCI 25140 01:47:27.198193 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:47:27.209376 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:47:27.220313 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:47:27.231571 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:47:27.242975 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:47:27.254376 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:47:27.372825 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:47:27.489404 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:47:27.960387 run create_hlr_db(pid=10401): Launched 01:47:28.078233 bus /sierra_2: Setting Powered False 01:47:29.139130 run create_hlr_db(pid=10401): Terminated: ok {rc=0} 01:47:29.583719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10403): Launched 01:47:29.890739 run osmo-hlr_10.42.42.2(pid=10404): Launched 01:47:30.008054 run osmo-stp_10.42.42.5: Starting osmo-stp 01:47:30.548469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10406): Launched 01:47:30.857691 run osmo-stp_10.42.42.5(pid=10407): Launched 01:47:31.024453 run osmo-msc_10.42.42.6: Starting osmo-msc 01:47:31.824107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10409): Launched 01:47:32.174569 run osmo-msc_10.42.42.6(pid=10410): Launched 01:47:32.607206 run osmo-stp_10.42.42.5(pid=10407): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10407)] 01:47:32.742626 run osmo-stp_10.42.42.5(pid=10407): stdout: | (launched: 2022-12-10_01:47:30.796920) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:32.876828 run osmo-stp_10.42.42.5(pid=10407): stderr: | 20221210014731122 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014731123 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014731123 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014731123 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014731124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014731124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014731124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:33.010751 run osmo-stp_10.42.42.5(pid=10407): stdout: | (launched: 2022-12-10_01:47:30.796920) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:33.139697 run osmo-stp_10.42.42.5(pid=10407): stderr: | 20221210014731122 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014731123 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014731123 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014731123 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014731124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014731124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014731124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:33.293555 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10407): Process ended prematurely: osmo-stp_10.42.42.5(pid=10407) [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10407)] [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 01:47:33.303086 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 01:47:33.330790 run osmo-hlr_10.42.42.2(pid=10404): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10404)] 01:47:33.380658 run osmo-hlr_10.42.42.2(pid=10404): stdout: | (launched: 2022-12-10_01:47:29.834513) 01:47:33.431622 run osmo-hlr_10.42.42.2(pid=10404): stderr: | 20221210014730010 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014730010 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014730011 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014730011 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014730011 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014730011 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014730023 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014730031 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014730032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014730032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:47:33.503382 run osmo-msc_10.42.42.6(pid=10410): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10410)] 01:47:33.553737 run osmo-msc_10.42.42.6(pid=10410): stdout: | (launched: 2022-12-10_01:47:32.118006) 01:47:33.604786 run osmo-msc_10.42.42.6(pid=10410): stderr: | 20221210014732470 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210014732471 DLGLOBAL DEBUG validating counter group 0x7f5e28ddfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210014732471 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210014732471 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210014732471 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210014732471 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210014732474 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210014732474 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210014732475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210014732475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:47:33.655893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10403): Terminating (SIGTERM) 01:47:33.697086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10406): Terminating (SIGTERM) 01:47:33.738193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10409): Terminating (SIGTERM) 01:47:33.779733 --- ParallelTerminationStrategy: PID 10403 died... 01:47:33.799529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10403): Terminated: ok {rc=0} 01:47:33.845178 --- ParallelTerminationStrategy: PID 10406 died... 01:47:33.864569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10406): Terminated: ok {rc=0} 01:47:33.910432 --- ParallelTerminationStrategy: PID 10409 died... 01:47:33.929699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10409): Terminated: ok {rc=0} 01:47:34.016086 bus /sierra_3: Setting Powered False 01:47:35.114873 bus /sierra_3: Setting Powered False 01:47:36.229164 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 01:47:37.483664 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:47:37.491148 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 01:47:37.523986 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 01:47:37.550357 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 01:47:37.603050 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 01:47:37.636220 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 01:47:37.663266 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 01:47:38.210711 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 01:47:38.259666 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:47:38.270884 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:47:38.337477 tst mo_mt_call.py: using LAC 25140 01:47:38.464719 tst mo_mt_call.py: using RAC 150 01:47:38.594912 tst mo_mt_call.py: using CellId 25140 01:47:38.722503 tst mo_mt_call.py: using BVCI 25141 01:47:38.841806 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:47:38.853674 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:47:38.865384 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:47:38.876921 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:47:38.888663 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:47:38.900210 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:47:39.017216 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:47:39.133795 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:47:39.605139 run create_hlr_db(pid=10415): Launched 01:47:39.723310 bus /sierra_2: Setting Powered False 01:47:40.784073 run create_hlr_db(pid=10415): Terminated: ok {rc=0} 01:47:41.208659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10417): Launched 01:47:41.514481 run osmo-hlr_10.42.42.2(pid=10418): Launched 01:47:41.631947 run osmo-stp_10.42.42.5: Starting osmo-stp 01:47:42.167846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10420): Launched 01:47:42.471400 run osmo-stp_10.42.42.5(pid=10421): Launched 01:47:42.587924 run osmo-msc_10.42.42.6: Starting osmo-msc 01:47:43.137786 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10423): Launched 01:47:43.442857 run osmo-msc_10.42.42.6(pid=10424): Launched 01:47:43.614605 run osmo-stp_10.42.42.5(pid=10421): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10421)] 01:47:43.743671 run osmo-stp_10.42.42.5(pid=10421): stdout: | (launched: 2022-12-10_01:47:42.415343) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:43.873998 run osmo-stp_10.42.42.5(pid=10421): stderr: | 20221210014742586 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014742587 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014742587 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014742587 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014742588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014742588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014742588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:44.000888 run osmo-stp_10.42.42.5(pid=10421): stdout: | (launched: 2022-12-10_01:47:42.415343) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:44.122065 run osmo-stp_10.42.42.5(pid=10421): stderr: | 20221210014742586 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014742587 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014742587 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014742587 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014742588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014742588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014742588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:44.266708 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10421): Process ended prematurely: osmo-stp_10.42.42.5(pid=10421) [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10421)] [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 01:47:44.275560 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:47:44.302567 run osmo-hlr_10.42.42.2(pid=10418): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10418)] 01:47:44.349855 run osmo-hlr_10.42.42.2(pid=10418): stdout: | (launched: 2022-12-10_01:47:41.457855) 01:47:44.398639 run osmo-hlr_10.42.42.2(pid=10418): stderr: | 20221210014741636 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014741636 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014741636 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014741636 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014741636 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014741637 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014741648 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014741657 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014741657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014741657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:47:44.467107 run osmo-msc_10.42.42.6(pid=10424): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10424)] 01:47:44.514362 run osmo-msc_10.42.42.6(pid=10424): stdout: | (launched: 2022-12-10_01:47:43.386381) 01:47:44.562998 run osmo-msc_10.42.42.6(pid=10424): stderr: | 20221210014743658 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210014743658 DLGLOBAL DEBUG validating counter group 0x7f693a3e7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210014743658 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210014743658 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210014743658 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210014743659 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210014743660 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210014743661 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210014743661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210014743661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:47:44.612239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10417): Terminating (SIGTERM) 01:47:44.651597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10420): Terminating (SIGTERM) 01:47:44.690630 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10423): Terminating (SIGTERM) 01:47:44.730243 --- ParallelTerminationStrategy: PID 10417 died... 01:47:44.749169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10417): Terminated: ok {rc=0} 01:47:44.792917 --- ParallelTerminationStrategy: PID 10420 died... 01:47:44.811745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10420): Terminated: ok {rc=0} 01:47:44.856001 --- ParallelTerminationStrategy: PID 10423 died... 01:47:44.874627 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10423): Terminated: ok {rc=0} 01:47:44.957805 bus /sierra_3: Setting Powered False 01:47:46.051197 bus /sierra_3: Setting Powered False 01:47:47.177978 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 01:47:48.330226 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:47:48.342910 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:47:48.412431 tst mo_mt_call_osmux.py: using LAC 25141 01:47:48.540678 tst mo_mt_call_osmux.py: using RAC 151 01:47:48.669098 tst mo_mt_call_osmux.py: using CellId 25141 01:47:48.795519 tst mo_mt_call_osmux.py: using BVCI 25142 01:47:48.913531 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:47:48.925808 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:47:48.937395 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:47:48.949464 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:47:48.961562 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:47:48.973232 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:47:49.090916 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:47:49.215633 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:47:49.722055 run create_hlr_db(pid=10426): Launched 01:47:49.856825 bus /sierra_2: Setting Powered False 01:47:50.921789 run create_hlr_db(pid=10426): Terminated: ok {rc=0} 01:47:51.355978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10428): Launched 01:47:51.663376 run osmo-hlr_10.42.42.2(pid=10429): Launched 01:47:51.783311 run osmo-stp_10.42.42.5: Starting osmo-stp 01:47:52.365731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10431): Launched 01:47:52.672530 run osmo-stp_10.42.42.5(pid=10432): Launched 01:47:52.788709 run osmo-msc_10.42.42.6: Starting osmo-msc 01:47:53.340937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10434): Launched 01:47:53.646761 run osmo-msc_10.42.42.6(pid=10435): Launched 01:47:53.818076 run osmo-stp_10.42.42.5(pid=10432): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10432)] 01:47:53.946996 run osmo-stp_10.42.42.5(pid=10432): stdout: | (launched: 2022-12-10_01:47:52.615380) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:54.075814 run osmo-stp_10.42.42.5(pid=10432): stderr: | 20221210014752789 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014752790 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014752790 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014752790 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014752791 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014752791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014752791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:54.202473 run osmo-stp_10.42.42.5(pid=10432): stdout: | (launched: 2022-12-10_01:47:52.615380) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:54.323419 run osmo-stp_10.42.42.5(pid=10432): stderr: | 20221210014752789 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014752790 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014752790 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014752790 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014752791 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014752791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014752791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:54.467842 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10432): Process ended prematurely: osmo-stp_10.42.42.5(pid=10432) [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10432)] [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 01:47:54.476861 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 01:47:54.503865 run osmo-hlr_10.42.42.2(pid=10429): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10429)] 01:47:54.551187 run osmo-hlr_10.42.42.2(pid=10429): stdout: | (launched: 2022-12-10_01:47:51.606347) 01:47:54.600255 run osmo-hlr_10.42.42.2(pid=10429): stderr: | 20221210014751784 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014751784 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014751784 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014751784 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014751784 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014751784 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014751796 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014751804 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014751804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014751804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:47:54.669109 run osmo-msc_10.42.42.6(pid=10435): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10435)] 01:47:54.716393 run osmo-msc_10.42.42.6(pid=10435): stdout: | (launched: 2022-12-10_01:47:53.590317) 01:47:54.765299 run osmo-msc_10.42.42.6(pid=10435): stderr: | 20221210014753867 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210014753867 DLGLOBAL DEBUG validating counter group 0x7efdf74bec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210014753867 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210014753867 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210014753868 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210014753868 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210014753870 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210014753870 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210014753870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210014753870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:47:54.814609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10428): Terminating (SIGTERM) 01:47:54.854106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10431): Terminating (SIGTERM) 01:47:54.893418 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10434): Terminating (SIGTERM) 01:47:54.933673 --- ParallelTerminationStrategy: PID 10428 died... 01:47:54.952511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10428): Terminated: ok {rc=0} 01:47:54.996245 --- ParallelTerminationStrategy: PID 10431 died... 01:47:55.014676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10431): Terminated: ok {rc=0} 01:47:55.058149 --- ParallelTerminationStrategy: PID 10434 died... 01:47:55.076450 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10434): Terminated: ok {rc=0} 01:47:55.163288 bus /sierra_3: Setting Powered False 01:47:56.263130 bus /sierra_3: Setting Powered False 01:47:57.378158 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 01:47:58.624380 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:47:58.631748 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 01:47:58.664390 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 01:47:58.690929 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 01:47:58.743044 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 01:47:58.775058 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 01:47:58.801382 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 01:47:59.351861 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 01:47:59.401239 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:47:59.412515 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:47:59.478389 tst mo_mt_call.py: using LAC 25142 01:47:59.595741 tst mo_mt_call.py: using RAC 152 01:47:59.713650 tst mo_mt_call.py: using CellId 25142 01:47:59.833589 tst mo_mt_call.py: using BVCI 25143 01:47:59.951537 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:47:59.963472 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:47:59.975385 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:47:59.987123 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:47:59.998942 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:48:00.010490 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:48:00.130856 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:48:00.245759 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:48:00.716559 run create_hlr_db(pid=10440): Launched 01:48:00.838443 bus /sierra_2: Setting Powered False 01:48:01.941486 run create_hlr_db(pid=10440): Terminated: ok {rc=0} 01:48:02.405375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10442): Launched 01:48:02.733586 run osmo-hlr_10.42.42.2(pid=10443): Launched 01:48:02.858367 run osmo-stp_10.42.42.5: Starting osmo-stp 01:48:03.420295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10445): Launched 01:48:03.747795 run osmo-stp_10.42.42.5(pid=10446): Launched 01:48:03.872335 run osmo-msc_10.42.42.6: Starting osmo-msc 01:48:04.461269 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10448): Launched 01:48:04.789267 run osmo-msc_10.42.42.6(pid=10449): Launched 01:48:04.970072 run osmo-stp_10.42.42.5(pid=10446): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10446)] 01:48:05.107278 run osmo-stp_10.42.42.5(pid=10446): stdout: | (launched: 2022-12-10_01:48:03.688272) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:48:05.244035 run osmo-stp_10.42.42.5(pid=10446): stderr: | 20221210014803882 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014803882 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014803882 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014803882 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014803883 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014803883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014803883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:48:05.380149 run osmo-stp_10.42.42.5(pid=10446): stdout: | (launched: 2022-12-10_01:48:03.688272) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:48:05.509538 run osmo-stp_10.42.42.5(pid=10446): stderr: | 20221210014803882 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014803882 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014803882 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014803882 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014803883 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014803883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014803883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:48:05.664760 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10446): Process ended prematurely: osmo-stp_10.42.42.5(pid=10446) [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10446)] [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 01:48:05.674314 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 01:48:05.702113 run osmo-hlr_10.42.42.2(pid=10443): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10443)] 01:48:05.751904 run osmo-hlr_10.42.42.2(pid=10443): stdout: | (launched: 2022-12-10_01:48:02.673629) 01:48:05.803577 run osmo-hlr_10.42.42.2(pid=10443): stderr: | 20221210014802874 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014802874 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014802874 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014802874 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014802874 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014802874 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014802887 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014802895 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014802895 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014802895 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:48:05.875556 run osmo-msc_10.42.42.6(pid=10449): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10449)] 01:48:05.925172 run osmo-msc_10.42.42.6(pid=10449): stdout: | (launched: 2022-12-10_01:48:04.729220) 01:48:05.976461 run osmo-msc_10.42.42.6(pid=10449): stderr: | 20221210014805052 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210014805053 DLGLOBAL DEBUG validating counter group 0x7f703be17c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210014805053 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210014805053 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210014805053 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210014805053 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210014805055 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210014805055 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210014805055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210014805055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:48:06.028140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10442): Terminating (SIGTERM) 01:48:06.069738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10445): Terminating (SIGTERM) 01:48:06.111131 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10448): Terminating (SIGTERM) 01:48:06.153079 --- ParallelTerminationStrategy: PID 10442 died... 01:48:06.172997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10442): Terminated: ok {rc=0} 01:48:06.218841 --- ParallelTerminationStrategy: PID 10445 died... 01:48:06.238424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10445): Terminated: ok {rc=0} 01:48:06.284472 --- ParallelTerminationStrategy: PID 10448 died... 01:48:06.304019 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10448): Terminated: ok {rc=0} 01:48:06.391063 bus /sierra_3: Setting Powered False 01:48:07.488922 bus /sierra_3: Setting Powered False 01:48:08.605376 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 01:48:09.753427 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:48:09.765907 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:48:09.834952 tst mo_mt_call_osmux.py: using LAC 25143 01:48:09.962759 tst mo_mt_call_osmux.py: using RAC 153 01:48:10.094489 tst mo_mt_call_osmux.py: using CellId 25143 01:48:10.220407 tst mo_mt_call_osmux.py: using BVCI 25144 01:48:10.339093 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:48:10.350795 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:48:10.362371 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:48:10.373894 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:48:10.385534 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:48:10.396854 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:48:10.516201 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:48:10.634505 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:48:11.105879 run create_hlr_db(pid=10451): Launched 01:48:11.225167 bus /sierra_2: Setting Powered False 01:48:12.285740 run create_hlr_db(pid=10451): Terminated: ok {rc=0} 01:48:12.730248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10453): Launched 01:48:13.056040 run osmo-hlr_10.42.42.2(pid=10454): Launched 01:48:13.180784 run osmo-stp_10.42.42.5: Starting osmo-stp 01:48:13.746300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10456): Launched 01:48:14.071565 run osmo-stp_10.42.42.5(pid=10457): Launched 01:48:14.195620 run osmo-msc_10.42.42.6: Starting osmo-msc 01:48:14.784026 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10459): Launched 01:48:15.110798 run osmo-msc_10.42.42.6(pid=10460): Launched 01:48:15.293600 run osmo-stp_10.42.42.5(pid=10457): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10457)] 01:48:15.430026 run osmo-stp_10.42.42.5(pid=10457): stdout: | (launched: 2022-12-10_01:48:14.011842) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:48:15.567210 run osmo-stp_10.42.42.5(pid=10457): stderr: | 20221210014814204 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014814204 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014814204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014814205 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014814205 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014814205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014814205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:48:15.702425 run osmo-stp_10.42.42.5(pid=10457): stdout: | (launched: 2022-12-10_01:48:14.011842) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:48:15.831726 run osmo-stp_10.42.42.5(pid=10457): stderr: | 20221210014814204 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014814204 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014814204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014814205 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014814205 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014814205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014814205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:48:16.000124 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10457): Process ended prematurely: osmo-stp_10.42.42.5(pid=10457) [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10457)] [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 01:48:16.010779 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 01:48:16.039732 run osmo-hlr_10.42.42.2(pid=10454): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10454)] 01:48:16.090745 run osmo-hlr_10.42.42.2(pid=10454): stdout: | (launched: 2022-12-10_01:48:12.996457) 01:48:16.142999 run osmo-hlr_10.42.42.2(pid=10454): stderr: | 20221210014813195 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014813195 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014813195 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014813195 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014813195 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014813195 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014813208 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014813216 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014813216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014813216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:48:16.216045 run osmo-msc_10.42.42.6(pid=10460): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10460)] 01:48:16.267264 run osmo-msc_10.42.42.6(pid=10460): stdout: | (launched: 2022-12-10_01:48:15.050928) 01:48:16.320034 run osmo-msc_10.42.42.6(pid=10460): stderr: | 20221210014815373 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210014815373 DLGLOBAL DEBUG validating counter group 0x7f4e699ddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210014815373 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210014815373 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210014815373 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210014815374 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210014815375 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210014815376 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210014815376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210014815376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:48:16.373309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10453): Terminating (SIGTERM) 01:48:16.415774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10456): Terminating (SIGTERM) 01:48:16.458021 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10459): Terminating (SIGTERM) 01:48:16.501234 --- ParallelTerminationStrategy: PID 10453 died... 01:48:16.521766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10453): Terminated: ok {rc=0} 01:48:16.570293 --- ParallelTerminationStrategy: PID 10456 died... 01:48:16.590759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10456): Terminated: ok {rc=0} 01:48:16.637775 --- ParallelTerminationStrategy: PID 10459 died... 01:48:16.657960 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10459): Terminated: ok {rc=0} 01:48:16.746185 bus /sierra_3: Setting Powered False 01:48:17.845883 bus /sierra_3: Setting Powered False 01:48:18.961538 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:48:20.215205 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:48:20.223166 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:48:20.256154 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 01:48:20.283332 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:48:20.335930 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:48:20.369403 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 01:48:20.396813 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:48:20.950241 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 01:48:21.001917 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:48:21.013679 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:48:21.082306 tst mo_mt_call.py: using LAC 25144 01:48:21.210075 tst mo_mt_call.py: using RAC 154 01:48:21.336623 tst mo_mt_call.py: using CellId 25144 01:48:21.462683 tst mo_mt_call.py: using BVCI 25145 01:48:21.582716 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:48:21.594528 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:48:21.606110 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:48:21.617721 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:48:21.629466 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:48:21.640930 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:48:21.757662 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:48:21.877096 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:48:22.349844 run create_hlr_db(pid=10465): Launched 01:48:22.468557 bus /sierra_2: Setting Powered False 01:48:23.529366 run create_hlr_db(pid=10465): Terminated: ok {rc=0} 01:48:23.953348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10467): Launched 01:48:24.258496 run osmo-hlr_10.42.42.2(pid=10468): Launched 01:48:24.376217 run osmo-stp_10.42.42.5: Starting osmo-stp 01:48:24.903889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10470): Launched 01:48:25.210400 run osmo-stp_10.42.42.5(pid=10471): Launched 01:48:25.328394 run osmo-msc_10.42.42.6: Starting osmo-msc 01:48:25.879337 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10473): Launched 01:48:26.185415 run osmo-msc_10.42.42.6(pid=10474): Launched 01:48:26.357565 run osmo-stp_10.42.42.5(pid=10471): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10471)] 01:48:26.487003 run osmo-stp_10.42.42.5(pid=10471): stdout: | (launched: 2022-12-10_01:48:25.154133) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:48:26.616291 run osmo-stp_10.42.42.5(pid=10471): stderr: | 20221210014825323 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014825323 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014825323 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014825324 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014825326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014825326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014825326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:48:26.743158 run osmo-stp_10.42.42.5(pid=10471): stdout: | (launched: 2022-12-10_01:48:25.154133) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:48:26.865408 run osmo-stp_10.42.42.5(pid=10471): stderr: | 20221210014825323 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014825323 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014825323 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014825324 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014825326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014825326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014825326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:48:27.011064 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10471): Process ended prematurely: osmo-stp_10.42.42.5(pid=10471) [trial-2367↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10471)] [trial-2367↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 01:48:27.020142 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:48:27.047444 run osmo-hlr_10.42.42.2(pid=10468): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10468)] 01:48:27.095457 run osmo-hlr_10.42.42.2(pid=10468): stdout: | (launched: 2022-12-10_01:48:24.202177) 01:48:27.145177 run osmo-hlr_10.42.42.2(pid=10468): stderr: | 20221210014824377 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014824377 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014824377 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014824377 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014824377 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014824377 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014824390 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014824399 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014824399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014824400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:48:27.214643 run osmo-msc_10.42.42.6(pid=10474): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10474)] 01:48:27.262507 run osmo-msc_10.42.42.6(pid=10474): stdout: | (launched: 2022-12-10_01:48:26.128918) 01:48:27.311996 run osmo-msc_10.42.42.6(pid=10474): stderr: | 20221210014826401 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210014826401 DLGLOBAL DEBUG validating counter group 0x7f9df9f7ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210014826401 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210014826402 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210014826402 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210014826402 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210014826403 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210014826404 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210014826404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210014826404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:48:27.362054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10467): Terminating (SIGTERM) 01:48:27.401847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10470): Terminating (SIGTERM) 01:48:27.441856 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10473): Terminating (SIGTERM) 01:48:27.481999 --- ParallelTerminationStrategy: PID 10467 died... 01:48:27.501108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10467): Terminated: ok {rc=0} 01:48:27.545404 --- ParallelTerminationStrategy: PID 10470 died... 01:48:27.564134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10470): Terminated: ok {rc=0} 01:48:27.609086 --- ParallelTerminationStrategy: PID 10473 died... 01:48:27.627723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10473): Terminated: ok {rc=0} 01:48:27.713294 bus /sierra_3: Setting Powered False 01:48:28.814943 bus /sierra_3: Setting Powered False 01:48:29.932106 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 01:48:31.083647 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:48:31.097134 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:48:31.167635 tst mo_mt_call_osmux.py: using LAC 25145 01:48:31.294393 tst mo_mt_call_osmux.py: using RAC 155 01:48:31.417807 tst mo_mt_call_osmux.py: using CellId 25145 01:48:31.540301 tst mo_mt_call_osmux.py: using BVCI 25146 01:48:31.655136 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:48:31.668338 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:48:31.682285 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:48:31.695577 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:48:31.707718 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:48:31.722120 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:48:31.843655 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:48:31.985923 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:48:32.488277 run create_hlr_db(pid=10476): Launched 01:48:32.607245 bus /sierra_2: Setting Powered False 01:48:33.667500 run create_hlr_db(pid=10476): Terminated: ok {rc=0} 01:48:34.092285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10478): Launched 01:48:34.398452 run osmo-hlr_10.42.42.2(pid=10479): Launched 01:48:34.518203 run osmo-stp_10.42.42.5: Starting osmo-stp 01:48:35.046897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10481): Launched 01:48:35.351536 run osmo-stp_10.42.42.5(pid=10482): Launched 01:48:35.470591 run osmo-msc_10.42.42.6: Starting osmo-msc 01:48:36.020477 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10484): Launched 01:48:36.324703 run osmo-msc_10.42.42.6(pid=10485): Launched 01:48:36.496056 run osmo-stp_10.42.42.5(pid=10482): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10482)] 01:48:36.624567 run osmo-stp_10.42.42.5(pid=10482): stdout: | (launched: 2022-12-10_01:48:35.295098) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:48:36.752733 run osmo-stp_10.42.42.5(pid=10482): stderr: | 20221210014835466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014835466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014835466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014835467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014835467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014835467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014835467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:48:36.879392 run osmo-stp_10.42.42.5(pid=10482): stdout: | (launched: 2022-12-10_01:48:35.295098) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:48:37.000245 run osmo-stp_10.42.42.5(pid=10482): stderr: | 20221210014835466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014835466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014835466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014835467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014835467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014835467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014835467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:48:37.145597 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10482): Process ended prematurely: osmo-stp_10.42.42.5(pid=10482) [trial-2367↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10482)] [trial-2367↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 01:48:37.154598 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 01:48:37.181756 run osmo-hlr_10.42.42.2(pid=10479): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10479)] 01:48:37.229537 run osmo-hlr_10.42.42.2(pid=10479): stdout: | (launched: 2022-12-10_01:48:34.341786) 01:48:37.278795 run osmo-hlr_10.42.42.2(pid=10479): stderr: | 20221210014834519 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014834519 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014834519 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014834519 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014834519 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014834519 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014834531 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014834540 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014834540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014834540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:48:37.347573 run osmo-msc_10.42.42.6(pid=10485): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10485)] 01:48:37.395900 run osmo-msc_10.42.42.6(pid=10485): stdout: | (launched: 2022-12-10_01:48:36.268341) 01:48:37.445353 run osmo-msc_10.42.42.6(pid=10485): stderr: | 20221210014836543 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210014836543 DLGLOBAL DEBUG validating counter group 0x7f06eeb2bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210014836543 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210014836543 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210014836544 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210014836544 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210014836546 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210014836546 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210014836546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210014836546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:48:37.495300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10478): Terminating (SIGTERM) 01:48:37.535188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10481): Terminating (SIGTERM) 01:48:37.574838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10484): Terminating (SIGTERM) 01:48:37.614967 --- ParallelTerminationStrategy: PID 10478 died... 01:48:37.634050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10478): Terminated: ok {rc=0} 01:48:37.678297 --- ParallelTerminationStrategy: PID 10481 died... 01:48:37.696935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10481): Terminated: ok {rc=0} 01:48:37.741380 --- ParallelTerminationStrategy: PID 10484 died... 01:48:37.759839 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10484): Terminated: ok {rc=0} 01:48:37.845844 bus /sierra_3: Setting Powered False 01:48:38.944698 bus /sierra_3: Setting Powered False 01:48:40.060930 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 01:48:41.310509 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:48:41.317371 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 01:48:41.349970 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 01:48:41.376351 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 01:48:41.430787 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 01:48:41.464305 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 01:48:41.492291 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 01:48:42.039874 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 01:48:42.090941 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:48:42.102340 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:48:42.153408 tst mo_mt_call.py: using LAC 25146 01:48:42.273686 tst mo_mt_call.py: using RAC 156 01:48:42.405697 tst mo_mt_call.py: using CellId 25146 01:48:42.527120 tst mo_mt_call.py: using BVCI 25147 01:48:42.639571 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:48:42.651029 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:48:42.662335 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:48:42.673738 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:48:42.685343 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:48:42.696721 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:48:42.817465 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:48:42.934103 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:48:43.407175 run create_hlr_db(pid=10490): Launched 01:48:43.523717 bus /sierra_2: Setting Powered False 01:48:44.585923 run create_hlr_db(pid=10490): Terminated: ok {rc=0} 01:48:45.031333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10492): Launched 01:48:45.359905 run osmo-hlr_10.42.42.2(pid=10493): Launched 01:48:45.486214 run osmo-stp_10.42.42.5: Starting osmo-stp 01:48:46.089728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10495): Launched 01:48:46.478460 run osmo-stp_10.42.42.5(pid=10496): Launched 01:48:46.692575 run osmo-msc_10.42.42.6: Starting osmo-msc 01:48:47.386280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10498): Launched 01:48:47.714890 run osmo-msc_10.42.42.6(pid=10499): Launched 01:48:47.897554 run osmo-stp_10.42.42.5(pid=10496): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10496)] 01:48:48.033545 run osmo-stp_10.42.42.5(pid=10496): stdout: | (launched: 2022-12-10_01:48:46.416109) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:48:48.170709 run osmo-stp_10.42.42.5(pid=10496): stderr: | 20221210014846786 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014846787 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014846787 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014846787 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014846788 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014846788 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014846788 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:48:48.306511 run osmo-stp_10.42.42.5(pid=10496): stdout: | (launched: 2022-12-10_01:48:46.416109) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:48:48.436141 run osmo-stp_10.42.42.5(pid=10496): stderr: | 20221210014846786 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014846787 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014846787 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014846787 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014846788 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014846788 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014846788 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:48:48.591751 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10496): Process ended prematurely: osmo-stp_10.42.42.5(pid=10496) [trial-2367↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10496)] [trial-2367↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 01:48:48.601895 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 01:48:48.630275 run osmo-hlr_10.42.42.2(pid=10493): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10493)] 01:48:48.680927 run osmo-hlr_10.42.42.2(pid=10493): stdout: | (launched: 2022-12-10_01:48:45.300063) 01:48:48.733339 run osmo-hlr_10.42.42.2(pid=10493): stderr: | 20221210014845499 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014845499 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014845499 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014845499 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014845499 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014845499 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014845512 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014845522 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014845522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014845522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:48:48.806065 run osmo-msc_10.42.42.6(pid=10499): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10499)] 01:48:48.856080 run osmo-msc_10.42.42.6(pid=10499): stdout: | (launched: 2022-12-10_01:48:47.655359) 01:48:48.907982 run osmo-msc_10.42.42.6(pid=10499): stderr: | 20221210014847981 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210014847981 DLGLOBAL DEBUG validating counter group 0x7f62105acc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210014847981 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210014847981 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210014847981 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210014847981 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210014847983 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210014847983 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210014847984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210014847984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:48:48.960248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10492): Terminating (SIGTERM) 01:48:49.002168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10495): Terminating (SIGTERM) 01:48:49.044230 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10498): Terminating (SIGTERM) 01:48:49.086521 --- ParallelTerminationStrategy: PID 10492 died... 01:48:49.106744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10492): Terminated: ok {rc=0} 01:48:49.153238 --- ParallelTerminationStrategy: PID 10495 died... 01:48:49.173312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10495): Terminated: ok {rc=0} 01:48:49.219462 --- ParallelTerminationStrategy: PID 10498 died... 01:48:49.239259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10498): Terminated: ok {rc=0} 01:48:49.326384 bus /sierra_3: Setting Powered False 01:48:50.426079 bus /sierra_3: Setting Powered False 01:48:51.543785 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 01:48:52.694133 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:48:52.706940 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:48:52.759747 tst mo_mt_call_osmux.py: using LAC 25147 01:48:52.892350 tst mo_mt_call_osmux.py: using RAC 157 01:48:53.019642 tst mo_mt_call_osmux.py: using CellId 25147 01:48:53.145469 tst mo_mt_call_osmux.py: using BVCI 25148 01:48:53.263249 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:48:53.275261 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:48:53.287105 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:48:53.298917 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:48:53.310842 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:48:53.322583 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:48:53.438966 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:48:53.561302 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:48:54.034398 run create_hlr_db(pid=10501): Launched 01:48:54.170218 bus /sierra_2: Setting Powered False 01:48:55.234414 run create_hlr_db(pid=10501): Terminated: ok {rc=0} 01:48:55.687602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10503): Launched 01:48:56.015115 run osmo-hlr_10.42.42.2(pid=10504): Launched 01:48:56.140818 run osmo-stp_10.42.42.5: Starting osmo-stp 01:48:56.700444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10506): Launched 01:48:57.028394 run osmo-stp_10.42.42.5(pid=10507): Launched 01:48:57.154841 run osmo-msc_10.42.42.6: Starting osmo-msc 01:48:57.744702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10509): Launched 01:48:58.072157 run osmo-msc_10.42.42.6(pid=10510): Launched 01:48:58.255984 run osmo-stp_10.42.42.5(pid=10507): ERR: Terminated: ERROR {rc=1} [trial-2367↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10507)] 01:48:58.393155 run osmo-stp_10.42.42.5(pid=10507): stdout: | (launched: 2022-12-10_01:48:56.968284) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:48:58.530603 run osmo-stp_10.42.42.5(pid=10507): stderr: | 20221210014857161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014857161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014857161 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014857162 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014857162 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014857162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014857162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:48:58.666913 run osmo-stp_10.42.42.5(pid=10507): stdout: | (launched: 2022-12-10_01:48:56.968284) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:48:58.797103 run osmo-stp_10.42.42.5(pid=10507): stderr: | 20221210014857161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014857161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014857161 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014857162 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014857162 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014857162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014857162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:48:58.952494 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10507): Process ended prematurely: osmo-stp_10.42.42.5(pid=10507) [trial-2367↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10507)] [trial-2367↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 01:48:58.962296 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 01:48:58.990599 run osmo-hlr_10.42.42.2(pid=10504): ERR: Terminated: ERROR {rc=237} [trial-2367↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10504)] 01:48:59.040813 run osmo-hlr_10.42.42.2(pid=10504): stdout: | (launched: 2022-12-10_01:48:55.954891) 01:48:59.092873 run osmo-hlr_10.42.42.2(pid=10504): stderr: | 20221210014856155 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014856155 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014856155 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014856155 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014856155 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014856155 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014856168 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014856177 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014856177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014856177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:48:59.165165 run osmo-msc_10.42.42.6(pid=10510): ERR: Terminated: ERROR {rc=2} [trial-2367↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10510)] 01:48:59.215386 run osmo-msc_10.42.42.6(pid=10510): stdout: | (launched: 2022-12-10_01:48:58.012028) 01:48:59.267160 run osmo-msc_10.42.42.6(pid=10510): stderr: | 20221210014858335 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210014858335 DLGLOBAL DEBUG validating counter group 0x7fe74b384c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210014858335 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210014858336 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210014858336 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210014858336 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210014858338 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210014858338 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210014858338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210014858338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:48:59.319138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10503): Terminating (SIGTERM) 01:48:59.361019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10506): Terminating (SIGTERM) 01:48:59.402773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10509): Terminating (SIGTERM) 01:48:59.444775 --- ParallelTerminationStrategy: PID 10503 died... 01:48:59.465071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10503): Terminated: ok {rc=0} 01:48:59.511874 --- ParallelTerminationStrategy: PID 10506 died... 01:48:59.531611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10506): Terminated: ok {rc=0} 01:48:59.577913 --- ParallelTerminationStrategy: PID 10509 died... 01:48:59.597703 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10509): Terminated: ok {rc=0} 01:48:59.684578 bus /sierra_3: Setting Powered False 01:49:00.782548 bus /sierra_3: Setting Powered False 01:49:01.901927 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 emergency:nanobts+band-900 --------------------------------------------------------------------- 01:49:03.155416 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:49:03.160768 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 01:49:03.193676 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 01:49:03.220137 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 01:49:03.303412 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 01:49:03.335327 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 01:49:03.361798 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 01:49:03.948280 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2367 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 01:49:03.953621 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:49:03.964302 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 01:49:04.012333 tst emergency_mo_mt_call.py: using LAC 25148 01:49:04.128672 tst emergency_mo_mt_call.py: using RAC 158 01:49:04.246817 tst emergency_mo_mt_call.py: using CellId 25148 01:49:04.363341 tst emergency_mo_mt_call.py: using BVCI 25149 01:49:04.470913 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:49:04.481694 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:49:04.492143 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:49:04.503147 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:49:04.514125 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:49:04.524836 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 01:49:04.642814 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 01:49:04.760595 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:49:05.254759 run create_hlr_db(pid=10515): Launched 01:49:05.386445 bus /sierra_2: Setting Powered False 01:49:06.450098 run create_hlr_db(pid=10515): Terminated: ok {rc=0} 01:49:06.879014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10517): Launched 01:49:07.180927 run osmo-hlr_10.42.42.2(pid=10518): Launched 01:49:07.297905 run osmo-stp_10.42.42.5: Starting osmo-stp 01:49:07.827777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10520): Launched 01:49:08.127433 run osmo-stp_10.42.42.5(pid=10521): Launched 01:49:08.252365 tst emergency_mo_mt_call.py: using MSISDN 7483 01:49:08.406742 run osmo-msc_10.42.42.6: Starting osmo-msc 01:49:08.938370 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10523): Launched 01:49:09.233753 run osmo-msc_10.42.42.6(pid=10524): Launched 01:49:09.398814 run osmo-stp_10.42.42.5(pid=10521): ERR: Terminated: ERROR {rc=1} [trial-2367↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10521)] 01:49:09.523979 run osmo-stp_10.42.42.5(pid=10521): stdout: | (launched: 2022-12-10_01:49:08.071870) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:49:09.649297 run osmo-stp_10.42.42.5(pid=10521): stderr: | 20221210014908243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014908243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014908243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014908244 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014908245 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014908245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014908245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:49:09.772459 run osmo-stp_10.42.42.5(pid=10521): stdout: | (launched: 2022-12-10_01:49:08.071870) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:49:09.889695 run osmo-stp_10.42.42.5(pid=10521): stderr: | 20221210014908243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014908243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014908243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014908244 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014908245 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014908245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014908245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:49:10.029290 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=10521): Process ended prematurely: osmo-stp_10.42.42.5(pid=10521) [trial-2367↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10521)] [trial-2367↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 01:49:10.037704 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 01:49:10.064270 run osmo-hlr_10.42.42.2(pid=10518): ERR: Terminated: ERROR {rc=237} [trial-2367↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10518)] 01:49:10.112455 run osmo-hlr_10.42.42.2(pid=10518): stdout: | (launched: 2022-12-10_01:49:07.125238) 01:49:10.161728 run osmo-hlr_10.42.42.2(pid=10518): stderr: | 20221210014907302 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014907302 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014907302 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014907302 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014907302 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014907302 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014907315 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014907325 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014907325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014907325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:49:10.230453 run osmo-msc_10.42.42.6(pid=10524): ERR: Terminated: ERROR {rc=2} [trial-2367↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10524)] 01:49:10.278274 run osmo-msc_10.42.42.6(pid=10524): stdout: | (launched: 2022-12-10_01:49:09.178331) 01:49:10.327495 run osmo-msc_10.42.42.6(pid=10524): stderr: | 20221210014909452 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210014909453 DLGLOBAL DEBUG validating counter group 0x7f835eec0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210014909453 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210014909453 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210014909453 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210014909453 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210014909455 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210014909455 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210014909455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210014909456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:49:10.376998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10517): Terminating (SIGTERM) 01:49:10.416727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10520): Terminating (SIGTERM) 01:49:10.456464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10523): Terminating (SIGTERM) 01:49:10.496198 --- ParallelTerminationStrategy: PID 10517 died... 01:49:10.515321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10517): Terminated: ok {rc=0} 01:49:10.559599 --- ParallelTerminationStrategy: PID 10520 died... 01:49:10.578139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10520): Terminated: ok {rc=0} 01:49:10.621888 --- ParallelTerminationStrategy: PID 10523 died... 01:49:10.640447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10523): Terminated: ok {rc=0} 01:49:10.723552 bus /sierra_3: Setting Powered False 01:49:11.821869 bus /sierra_3: Setting Powered False 01:49:12.937650 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 01:49:14.024102 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:49:14.035949 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 01:49:14.086410 tst emergency_preemptive_call.py: using LAC 25149 01:49:14.211758 tst emergency_preemptive_call.py: using RAC 159 01:49:14.336553 tst emergency_preemptive_call.py: using CellId 25149 01:49:14.460871 tst emergency_preemptive_call.py: using BVCI 25150 01:49:14.576658 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:49:14.587979 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:49:14.598886 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:49:14.609843 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:49:14.620691 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:49:14.631587 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 01:49:14.744698 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 01:49:14.865023 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 01:49:14.983282 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 01:49:15.095778 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:49:15.555221 run create_hlr_db(pid=10526): Launched 01:49:15.669865 bus /sierra_2: Setting Powered False 01:49:16.729323 run create_hlr_db(pid=10526): Terminated: ok {rc=0} 01:49:17.183058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10528): Launched 01:49:17.518190 run osmo-hlr_10.42.42.2(pid=10529): Launched 01:49:17.639077 run osmo-stp_10.42.42.5: Starting osmo-stp 01:49:18.183105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10531): Launched 01:49:18.497570 run osmo-stp_10.42.42.5(pid=10532): Launched 01:49:18.635057 tst emergency_preemptive_call.py: using MSISDN 7484 01:49:18.792127 run osmo-msc_10.42.42.6: Starting osmo-msc 01:49:19.349054 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10534): Launched 01:49:19.659101 run osmo-msc_10.42.42.6(pid=10535): Launched 01:49:19.831302 run osmo-stp_10.42.42.5(pid=10532): ERR: Terminated: ERROR {rc=1} [trial-2367↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10532)] 01:49:19.961584 run osmo-stp_10.42.42.5(pid=10532): stdout: | (launched: 2022-12-10_01:49:18.439433) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:49:20.092364 run osmo-stp_10.42.42.5(pid=10532): stderr: | 20221210014918632 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014918633 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014918633 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014918633 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014918634 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014918634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014918634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:49:20.222230 run osmo-stp_10.42.42.5(pid=10532): stdout: | (launched: 2022-12-10_01:49:18.439433) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:49:20.345051 run osmo-stp_10.42.42.5(pid=10532): stderr: | 20221210014918632 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014918633 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014918633 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014918633 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014918634 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014918634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014918634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:49:20.492298 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=10532): Process ended prematurely: osmo-stp_10.42.42.5(pid=10532) [trial-2367↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10532)] [trial-2367↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 01:49:20.501241 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 01:49:20.528743 run osmo-hlr_10.42.42.2(pid=10529): ERR: Terminated: ERROR {rc=237} [trial-2367↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10529)] 01:49:20.578177 run osmo-hlr_10.42.42.2(pid=10529): stdout: | (launched: 2022-12-10_01:49:17.459447) 01:49:20.629263 run osmo-hlr_10.42.42.2(pid=10529): stderr: | 20221210014917657 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014917657 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014917657 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014917657 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014917657 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014917657 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014917670 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014917678 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014917679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014917679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:49:20.700504 run osmo-msc_10.42.42.6(pid=10535): ERR: Terminated: ERROR {rc=2} [trial-2367↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10535)] 01:49:20.749539 run osmo-msc_10.42.42.6(pid=10535): stdout: | (launched: 2022-12-10_01:49:19.602150) 01:49:20.800376 run osmo-msc_10.42.42.6(pid=10535): stderr: | 20221210014919923 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210014919924 DLGLOBAL DEBUG validating counter group 0x7f39d5f4cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210014919924 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210014919924 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210014919924 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210014919924 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210014919926 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210014919926 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210014919927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210014919927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:49:20.851691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10528): Terminating (SIGTERM) 01:49:20.892714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10531): Terminating (SIGTERM) 01:49:20.933857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10534): Terminating (SIGTERM) 01:49:20.975248 --- ParallelTerminationStrategy: PID 10528 died... 01:49:20.995006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10528): Terminated: ok {rc=0} 01:49:21.040552 --- ParallelTerminationStrategy: PID 10531 died... 01:49:21.059990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10531): Terminated: ok {rc=0} 01:49:21.105966 --- ParallelTerminationStrategy: PID 10534 died... 01:49:21.125330 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10534): Terminated: ok {rc=0} 01:49:21.211963 bus /sierra_9: Setting Powered False 01:49:22.310564 bus /sierra_9: Setting Powered False 01:49:23.424731 bus /sierra_8: Setting Powered False 01:49:24.522154 bus /sierra_8: Setting Powered False 01:49:25.638329 bus /sierra_3: Setting Powered False 01:49:26.734839 bus /sierra_3: Setting Powered False 01:49:27.849349 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:nanobts+band-900 --------------------------------------------------------------------- 01:49:29.122131 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:49:29.127186 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 01:49:29.159291 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 01:49:29.196707 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 01:49:29.281590 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 01:49:29.313089 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 01:49:29.350564 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 01:49:29.939314 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 01:49:29.987863 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:29.998380 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 01:49:30.044682 tst cs_paging_gprs_active.py: using LAC 25150 01:49:30.161244 tst cs_paging_gprs_active.py: using RAC 160 01:49:30.277417 tst cs_paging_gprs_active.py: using CellId 25150 01:49:30.402654 tst cs_paging_gprs_active.py: using BVCI 25151 01:49:30.520171 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:30.531562 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:30.542634 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:30.553881 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:30.565216 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:30.576367 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:30.587729 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:30.598955 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:30.610301 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 01:49:30.723962 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 01:49:30.847840 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:49:31.079633 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:49:31.417741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10540): Launched 01:49:31.696391 run iperf3-srv_10.42.42.10(pid=10541): Launched 01:49:31.826273 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:49:32.029468 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:49:32.332239 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10542): Launched 01:49:32.591432 run iperf3-srv_10.42.42.10(pid=10543): Launched 01:49:32.702220 tst cs_paging_gprs_active.py:38: start network... 01:49:32.899032 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:49:33.355723 run create_hlr_db(pid=10544): Launched 01:49:33.470587 bus /sierra_2: Setting Powered False 01:49:34.529959 run create_hlr_db(pid=10544): Terminated: ok {rc=0} 01:49:34.941418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10546): Launched 01:49:35.238932 run osmo-hlr_10.42.42.2(pid=10547): Launched 01:49:35.352020 run osmo-stp_10.42.42.5: Starting osmo-stp 01:49:35.857768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10549): Launched 01:49:36.153161 run osmo-stp_10.42.42.5(pid=10550): Launched 01:49:36.266527 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:49:36.775314 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10552): Launched 01:49:36.887902 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:49:37.137306 run patchelf(pid=10553): Launched 01:49:37.302001 run osmo-stp_10.42.42.5(pid=10550): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10550)] 01:49:37.427135 run osmo-stp_10.42.42.5(pid=10550): stdout: | (launched: 2022-12-10_01:49:36.098490) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:49:37.553629 run osmo-stp_10.42.42.5(pid=10550): stderr: | 20221210014936266 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014936266 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014936267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014936267 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014936267 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014936268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014936268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:49:37.679976 run osmo-stp_10.42.42.5(pid=10550): stdout: | (launched: 2022-12-10_01:49:36.098490) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:49:37.800560 run osmo-stp_10.42.42.5(pid=10550): stderr: | 20221210014936266 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014936266 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014936267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014936267 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014936267 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014936268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014936268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:49:37.943845 run patchelf(pid=10553): Terminating (SIGINT) 01:49:38.109083 run patchelf(pid=10553): Terminated: ok {rc=0} 01:49:38.228335 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10550): Process ended prematurely: osmo-stp_10.42.42.5(pid=10550) [trial-2367↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10550)] [trial-2367↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 01:49:38.237701 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 01:49:38.265240 run osmo-hlr_10.42.42.2(pid=10547): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10547)] 01:49:38.312449 run osmo-hlr_10.42.42.2(pid=10547): stdout: | (launched: 2022-12-10_01:49:35.183927) 01:49:38.361581 run osmo-hlr_10.42.42.2(pid=10547): stderr: | 20221210014935359 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014935359 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014935359 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014935359 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014935359 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014935360 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014935372 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014935381 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014935381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014935381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:49:38.410975 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10540): Terminating (SIGTERM) 01:49:38.450315 run iperf3-srv_10.42.42.10(pid=10541): Terminating (SIGTERM) 01:49:38.489316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10542): Terminating (SIGTERM) 01:49:38.528353 run iperf3-srv_10.42.42.10(pid=10543): Terminating (SIGTERM) 01:49:38.567275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10546): Terminating (SIGTERM) 01:49:38.606241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10549): Terminating (SIGTERM) 01:49:38.645237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10552): Terminating (SIGTERM) 01:49:38.684604 --- ParallelTerminationStrategy: PID 10540 died... 01:49:38.703492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10540): Terminated: ok {rc=0} 01:49:38.747166 --- ParallelTerminationStrategy: PID 10541 died... 01:49:38.765412 run iperf3-srv_10.42.42.10(pid=10541): Terminated {rc=256} 01:49:38.809052 --- ParallelTerminationStrategy: PID 10542 died... 01:49:38.827361 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10542): Terminated: ok {rc=0} 01:49:38.870727 --- ParallelTerminationStrategy: PID 10543 died... 01:49:38.888759 run iperf3-srv_10.42.42.10(pid=10543): Terminated {rc=256} 01:49:38.932284 --- ParallelTerminationStrategy: PID 10546 died... 01:49:38.950528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10546): Terminated: ok {rc=0} 01:49:38.994005 --- ParallelTerminationStrategy: PID 10549 died... 01:49:39.012469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10549): Terminated: ok {rc=0} 01:49:39.056062 --- ParallelTerminationStrategy: PID 10552 died... 01:49:39.074508 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10552): Terminated: ok {rc=0} 01:49:39.159421 bus /gobi_0: Setting Powered False 01:49:40.258794 bus /gobi_0: Setting Powered False 01:49:41.370578 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 01:49:42.510431 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:42.521843 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 01:49:42.571302 tst iperf3.py: using LAC 25151 01:49:42.686690 tst iperf3.py: using RAC 161 01:49:42.803826 tst iperf3.py: using CellId 25151 01:49:42.920396 tst iperf3.py: using BVCI 25152 01:49:43.029233 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:43.040074 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:43.050720 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:43.061605 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:43.072265 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:43.082890 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:43.093639 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:43.104259 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:43.115155 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 01:49:43.231255 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:49:43.445936 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:49:43.764284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10554): Launched 01:49:44.040045 run iperf3-srv_10.42.42.10(pid=10555): Launched 01:49:44.159145 tst iperf3.py:8: start network... 01:49:44.371822 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:49:44.862691 run create_hlr_db(pid=10556): Launched 01:49:44.991264 bus /gobi_6: Setting Powered False 01:49:46.052372 run create_hlr_db(pid=10556): Terminated: ok {rc=0} 01:49:46.506547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10558): Launched 01:49:46.851562 run osmo-hlr_10.42.42.2(pid=10559): Launched 01:49:47.087234 run osmo-stp_10.42.42.5: Starting osmo-stp 01:49:47.671388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10561): Launched 01:49:47.989176 run osmo-stp_10.42.42.5(pid=10562): Launched 01:49:48.110975 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:49:48.658742 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10564): Launched 01:49:48.779695 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:49:49.046171 run patchelf(pid=10565): Launched 01:49:49.223115 run osmo-stp_10.42.42.5(pid=10562): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10562)] 01:49:49.359380 run osmo-stp_10.42.42.5(pid=10562): stdout: | (launched: 2022-12-10_01:49:47.930866) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:49:49.494857 run osmo-stp_10.42.42.5(pid=10562): stderr: | 20221210014948122 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014948122 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014948122 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014948123 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014948123 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014948123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014948123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:49:49.631078 run osmo-stp_10.42.42.5(pid=10562): stdout: | (launched: 2022-12-10_01:49:47.930866) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:49:49.761132 run osmo-stp_10.42.42.5(pid=10562): stderr: | 20221210014948122 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210014948122 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210014948122 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210014948123 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210014948123 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210014948123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210014948123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:49:49.915158 run patchelf(pid=10565): Terminating (SIGINT) 01:49:50.092098 run patchelf(pid=10565): Terminated: ok {rc=0} 01:49:50.219758 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10562): Process ended prematurely: osmo-stp_10.42.42.5(pid=10562) [trial-2367↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10562)] [trial-2367↪gprs:nanobts+band-900↪iperf3.py:8] 01:49:50.230013 tst iperf3.py:8: Test FAILED (7.8 sec) 01:49:50.258529 run osmo-hlr_10.42.42.2(pid=10559): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10559)] 01:49:50.308320 run osmo-hlr_10.42.42.2(pid=10559): stdout: | (launched: 2022-12-10_01:49:46.777484) 01:49:50.359947 run osmo-hlr_10.42.42.2(pid=10559): stderr: | 20221210014947117 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014947117 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014947117 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014947117 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014947117 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014947118 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014947139 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014947155 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014947155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014947155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:49:50.411928 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10554): Terminating (SIGTERM) 01:49:50.453644 run iperf3-srv_10.42.42.10(pid=10555): Terminating (SIGTERM) 01:49:50.495274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10558): Terminating (SIGTERM) 01:49:50.537549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10561): Terminating (SIGTERM) 01:49:50.579434 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10564): Terminating (SIGTERM) 01:49:50.621461 --- ParallelTerminationStrategy: PID 10554 died... 01:49:50.641470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10554): Terminated: ok {rc=0} 01:49:50.687687 --- ParallelTerminationStrategy: PID 10555 died... 01:49:50.707228 run iperf3-srv_10.42.42.10(pid=10555): Terminated {rc=256} 01:49:50.753056 --- ParallelTerminationStrategy: PID 10558 died... 01:49:50.772529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10558): Terminated: ok {rc=0} 01:49:50.818482 --- ParallelTerminationStrategy: PID 10561 died... 01:49:50.838156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10561): Terminated: ok {rc=0} 01:49:50.884092 --- ParallelTerminationStrategy: PID 10564 died... 01:49:50.903622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10564): Terminated: ok {rc=0} 01:49:50.991065 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 01:49:52.143097 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:52.155074 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 01:49:52.205762 tst iperf3m4.py: using LAC 25152 01:49:52.322087 tst iperf3m4.py: using RAC 162 01:49:52.438201 tst iperf3m4.py: using CellId 25152 01:49:52.553826 tst iperf3m4.py: using BVCI 25153 01:49:52.662087 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:52.673396 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:52.683940 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:52.694798 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:52.705609 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:52.716460 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:52.727360 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:52.737947 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:52.748716 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 01:49:52.867866 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 01:49:52.985458 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 01:49:53.099613 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 01:49:53.218143 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:49:53.432259 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:49:53.749934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10566): Launched 01:49:54.025173 run iperf3-srv_10.42.42.10(pid=10567): Launched 01:49:54.144634 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:49:54.357347 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:49:54.674704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10568): Launched 01:49:54.949311 run iperf3-srv_10.42.42.10(pid=10569): Launched 01:49:55.068229 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:49:55.280884 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:49:55.598456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10570): Launched 01:49:55.873651 run iperf3-srv_10.42.42.10(pid=10571): Launched 01:49:55.992262 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:49:56.203974 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:49:56.519984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10572): Launched 01:49:56.795123 run iperf3-srv_10.42.42.10(pid=10573): Launched 01:49:56.913941 tst iperf3m4.py:8: start network... 01:49:57.125891 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:49:57.618436 run create_hlr_db(pid=10574): Launched 01:49:57.747623 bus /gobi_6: Setting Powered False 01:49:58.810626 run create_hlr_db(pid=10574): Terminated: ok {rc=0} 01:49:59.233685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10576): Launched 01:49:59.531867 run osmo-hlr_10.42.42.2(pid=10577): Launched 01:49:59.645772 run osmo-stp_10.42.42.5: Starting osmo-stp 01:50:00.171708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10579): Launched 01:50:00.467631 run osmo-stp_10.42.42.5(pid=10580): Launched 01:50:00.581447 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:50:01.107431 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10582): Launched 01:50:01.286513 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:50:01.602242 run patchelf(pid=10586): Launched 01:50:01.798824 run osmo-stp_10.42.42.5(pid=10580): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10580)] 01:50:01.963152 run osmo-stp_10.42.42.5(pid=10580): stdout: | (launched: 2022-12-10_01:50:00.413275) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:50:02.104345 run osmo-stp_10.42.42.5(pid=10580): stderr: | 20221210015000579 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015000579 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015000579 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015000580 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015000580 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015000580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015000581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:50:02.245225 run osmo-stp_10.42.42.5(pid=10580): stdout: | (launched: 2022-12-10_01:50:00.413275) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:50:02.379474 run osmo-stp_10.42.42.5(pid=10580): stderr: | 20221210015000579 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015000579 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015000579 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015000580 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015000580 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015000580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015000581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:50:02.536265 run patchelf(pid=10586): Terminating (SIGINT) 01:50:02.715687 run patchelf(pid=10586): Terminated: ok {rc=0} 01:50:02.845158 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10580): Process ended prematurely: osmo-stp_10.42.42.5(pid=10580) [trial-2367↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10580)] [trial-2367↪gprs:nanobts+band-900↪iperf3m4.py:8] 01:50:02.855378 tst iperf3m4.py:8: Test FAILED (10.8 sec) 01:50:02.884591 run osmo-hlr_10.42.42.2(pid=10577): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10577)] 01:50:02.934668 run osmo-hlr_10.42.42.2(pid=10577): stdout: | (launched: 2022-12-10_01:49:59.476616) 01:50:02.986578 run osmo-hlr_10.42.42.2(pid=10577): stderr: | 20221210014959649 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210014959649 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210014959649 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210014959649 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210014959649 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210014959649 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210014959662 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210014959673 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210014959673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210014959673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:50:03.038984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10566): Terminating (SIGTERM) 01:50:03.081246 run iperf3-srv_10.42.42.10(pid=10567): Terminating (SIGTERM) 01:50:03.123405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10568): Terminating (SIGTERM) 01:50:03.165605 run iperf3-srv_10.42.42.10(pid=10569): Terminating (SIGTERM) 01:50:03.208118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10570): Terminating (SIGTERM) 01:50:03.250392 run iperf3-srv_10.42.42.10(pid=10571): Terminating (SIGTERM) 01:50:03.292451 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10572): Terminating (SIGTERM) 01:50:03.334541 run iperf3-srv_10.42.42.10(pid=10573): Terminating (SIGTERM) 01:50:03.376750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10576): Terminating (SIGTERM) 01:50:03.418953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10579): Terminating (SIGTERM) 01:50:03.461087 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10582): Terminating (SIGTERM) 01:50:03.503277 --- ParallelTerminationStrategy: PID 10566 died... 01:50:03.523393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10566): Terminated: ok {rc=0} 01:50:03.570560 --- ParallelTerminationStrategy: PID 10567 died... 01:50:03.590460 run iperf3-srv_10.42.42.10(pid=10567): Terminated {rc=256} 01:50:03.637065 --- ParallelTerminationStrategy: PID 10568 died... 01:50:03.656663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10568): Terminated: ok {rc=0} 01:50:03.703116 --- ParallelTerminationStrategy: PID 10569 died... 01:50:03.722732 run iperf3-srv_10.42.42.10(pid=10569): Terminated {rc=256} 01:50:03.768770 --- ParallelTerminationStrategy: PID 10570 died... 01:50:03.788792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10570): Terminated: ok {rc=0} 01:50:03.835040 --- ParallelTerminationStrategy: PID 10571 died... 01:50:03.854649 run iperf3-srv_10.42.42.10(pid=10571): Terminated {rc=256} 01:50:03.900902 --- ParallelTerminationStrategy: PID 10572 died... 01:50:03.920578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10572): Terminated: ok {rc=0} 01:50:03.966762 --- ParallelTerminationStrategy: PID 10573 died... 01:50:03.986484 run iperf3-srv_10.42.42.10(pid=10573): Terminated {rc=256} 01:50:04.032706 --- ParallelTerminationStrategy: PID 10576 died... 01:50:04.052368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10576): Terminated: ok {rc=0} 01:50:04.098986 --- ParallelTerminationStrategy: PID 10579 died... 01:50:04.118762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10579): Terminated: ok {rc=0} 01:50:04.165013 --- ParallelTerminationStrategy: PID 10582 died... 01:50:04.185113 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10582): Terminated: ok {rc=0} 01:50:04.272869 bus /gobi_4: Setting Powered False 01:50:05.371534 bus /gobi_4: Setting Powered False 01:50:06.487138 bus /gobi_1: Setting Powered False 01:50:07.582100 bus /gobi_1: Setting Powered False 01:50:08.696386 bus /gobi_0: Setting Powered False 01:50:09.793977 bus /gobi_0: Setting Powered False 01:50:10.910740 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:nanobts+band-900 ping.py ---------------------------------------------- 01:50:12.017187 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:12.028734 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 01:50:12.077413 tst ping.py: using LAC 25153 01:50:12.200942 tst ping.py: using RAC 163 01:50:12.323901 tst ping.py: using CellId 25153 01:50:12.447396 tst ping.py: using BVCI 25154 01:50:12.555382 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:12.566404 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:12.577194 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:12.588292 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:12.600360 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:12.610958 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:12.621741 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:12.632400 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 01:50:12.743467 tst ping.py:19: start network... 01:50:12.940838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:50:13.399077 run create_hlr_db(pid=10587): Launched 01:50:13.513433 bus /gobi_6: Setting Powered False 01:50:14.573183 run create_hlr_db(pid=10587): Terminated: ok {rc=0} 01:50:15.006426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10589): Launched 01:50:15.325546 run osmo-hlr_10.42.42.2(pid=10590): Launched 01:50:15.447793 run osmo-stp_10.42.42.5: Starting osmo-stp 01:50:16.014268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10592): Launched 01:50:16.343174 run osmo-stp_10.42.42.5(pid=10593): Launched 01:50:16.553543 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:50:17.326388 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10595): Launched 01:50:17.447739 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:50:17.715742 run patchelf(pid=10596): Launched 01:50:17.892794 run osmo-stp_10.42.42.5(pid=10593): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10593)] 01:50:18.026679 run osmo-stp_10.42.42.5(pid=10593): stdout: | (launched: 2022-12-10_01:50:16.283064) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:50:18.161941 run osmo-stp_10.42.42.5(pid=10593): stderr: | 20221210015016609 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015016609 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015016613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015016614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015016614 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015016614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015016614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:50:18.297063 run osmo-stp_10.42.42.5(pid=10593): stdout: | (launched: 2022-12-10_01:50:16.283064) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:50:18.426966 run osmo-stp_10.42.42.5(pid=10593): stderr: | 20221210015016609 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015016609 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015016613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015016614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015016614 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015016614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015016614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:50:18.581387 run patchelf(pid=10596): Terminating (SIGINT) 01:50:18.758164 run patchelf(pid=10596): Terminated: ok {rc=0} 01:50:18.885172 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10593): Process ended prematurely: osmo-stp_10.42.42.5(pid=10593) [trial-2367↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10593)] [trial-2367↪gprs:nanobts+band-900↪ping.py:22] 01:50:18.894642 tst ping.py:22: Test FAILED (6.9 sec) 01:50:18.922803 run osmo-hlr_10.42.42.2(pid=10590): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10590)] 01:50:18.972632 run osmo-hlr_10.42.42.2(pid=10590): stdout: | (launched: 2022-12-10_01:50:15.266421) 01:50:19.024245 run osmo-hlr_10.42.42.2(pid=10590): stderr: | 20221210015015466 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015015466 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015015466 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015015466 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015015466 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015015467 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015015478 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015015487 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015015487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015015487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:50:19.076081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10589): Terminating (SIGTERM) 01:50:19.117612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10592): Terminating (SIGTERM) 01:50:19.159137 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10595): Terminating (SIGTERM) 01:50:19.201212 --- ParallelTerminationStrategy: PID 10589 died... 01:50:19.221258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10589): Terminated: ok {rc=0} 01:50:19.267145 --- ParallelTerminationStrategy: PID 10592 died... 01:50:19.286791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10592): Terminated: ok {rc=0} 01:50:19.333168 --- ParallelTerminationStrategy: PID 10595 died... 01:50:19.352718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10595): Terminated: ok {rc=0} 01:50:19.439396 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 01:50:20.527228 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:20.539134 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 01:50:20.588665 tst ping_idle_ping.py: using LAC 25154 01:50:20.707308 tst ping_idle_ping.py: using RAC 164 01:50:20.837542 tst ping_idle_ping.py: using CellId 25154 01:50:20.962897 tst ping_idle_ping.py: using BVCI 25155 01:50:21.071876 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:21.082688 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:21.093489 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:21.104815 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:21.116311 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:21.127624 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:21.139109 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:21.150474 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 01:50:21.267451 tst ping_idle_ping.py:24: start network... 01:50:21.465602 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:50:21.927380 run create_hlr_db(pid=10597): Launched 01:50:22.041083 bus /gobi_6: Setting Powered False 01:50:23.100763 run create_hlr_db(pid=10597): Terminated: ok {rc=0} 01:50:23.535311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10599): Launched 01:50:23.853634 run osmo-hlr_10.42.42.2(pid=10600): Launched 01:50:23.975195 run osmo-stp_10.42.42.5: Starting osmo-stp 01:50:24.522985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10602): Launched 01:50:24.840812 run osmo-stp_10.42.42.5(pid=10603): Launched 01:50:24.962337 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:50:25.509849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10605): Launched 01:50:25.631486 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:50:25.898989 run patchelf(pid=10606): Launched 01:50:26.075467 run osmo-stp_10.42.42.5(pid=10603): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10603)] 01:50:26.209182 run osmo-stp_10.42.42.5(pid=10603): stdout: | (launched: 2022-12-10_01:50:24.782347) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:50:26.344601 run osmo-stp_10.42.42.5(pid=10603): stderr: | 20221210015024974 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015024975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015024975 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015024975 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015024976 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015024976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015024976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:50:26.479729 run osmo-stp_10.42.42.5(pid=10603): stdout: | (launched: 2022-12-10_01:50:24.782347) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:50:26.611031 run osmo-stp_10.42.42.5(pid=10603): stderr: | 20221210015024974 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015024975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015024975 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015024975 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015024976 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015024976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015024976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:50:26.764391 run patchelf(pid=10606): Terminating (SIGINT) 01:50:26.940466 run patchelf(pid=10606): Terminated: ok {rc=0} 01:50:27.067636 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10603): Process ended prematurely: osmo-stp_10.42.42.5(pid=10603) [trial-2367↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10603)] [trial-2367↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 01:50:27.077154 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 01:50:27.105196 run osmo-hlr_10.42.42.2(pid=10600): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10600)] 01:50:27.154966 run osmo-hlr_10.42.42.2(pid=10600): stdout: | (launched: 2022-12-10_01:50:23.795198) 01:50:27.206592 run osmo-hlr_10.42.42.2(pid=10600): stderr: | 20221210015023995 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015023995 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015023995 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015023995 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015023995 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015023995 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015024008 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015024018 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015024018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015024018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:50:27.258066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10599): Terminating (SIGTERM) 01:50:27.299723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10602): Terminating (SIGTERM) 01:50:27.341596 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10605): Terminating (SIGTERM) 01:50:27.383921 --- ParallelTerminationStrategy: PID 10599 died... 01:50:27.403836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10599): Terminated: ok {rc=0} 01:50:27.450018 --- ParallelTerminationStrategy: PID 10602 died... 01:50:27.469740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10602): Terminated: ok {rc=0} 01:50:27.515479 --- ParallelTerminationStrategy: PID 10605 died... 01:50:27.535319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10605): Terminated: ok {rc=0} 01:50:27.621062 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 01:50:28.926770 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:50:28.933383 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 01:50:28.966226 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 01:50:29.005156 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 01:50:29.094917 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 01:50:29.127902 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 01:50:29.166835 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 01:50:29.762892 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 01:50:29.814329 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:29.825404 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:50:29.875946 tst cs_paging_gprs_active.py: using LAC 25155 01:50:29.996062 tst cs_paging_gprs_active.py: using RAC 165 01:50:30.124817 tst cs_paging_gprs_active.py: using CellId 25155 01:50:30.251210 tst cs_paging_gprs_active.py: using BVCI 25156 01:50:30.369552 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:30.380891 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:30.392179 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:30.403456 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:30.414642 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:30.425725 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:30.436808 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:30.447799 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:30.458996 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:50:30.574033 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:50:30.689960 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:50:30.908367 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:50:31.225096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10611): Launched 01:50:31.512424 run iperf3-srv_10.42.42.10(pid=10612): Launched 01:50:31.644259 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:50:31.854022 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:50:32.169500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10613): Launched 01:50:32.437319 run iperf3-srv_10.42.42.10(pid=10614): Launched 01:50:32.550523 tst cs_paging_gprs_active.py:38: start network... 01:50:32.752243 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:50:33.218624 run create_hlr_db(pid=10615): Launched 01:50:33.334044 bus /gobi_6: Setting Powered False 01:50:34.393517 run create_hlr_db(pid=10615): Terminated: ok {rc=0} 01:50:34.811468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10617): Launched 01:50:35.111873 run osmo-hlr_10.42.42.2(pid=10618): Launched 01:50:35.226818 run osmo-stp_10.42.42.5: Starting osmo-stp 01:50:35.743773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10620): Launched 01:50:36.046136 run osmo-stp_10.42.42.5(pid=10621): Launched 01:50:36.161814 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:50:36.681460 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10623): Launched 01:50:36.797690 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:50:37.054651 run patchelf(pid=10624): Launched 01:50:37.223741 run osmo-stp_10.42.42.5(pid=10621): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10621)] 01:50:37.352059 run osmo-stp_10.42.42.5(pid=10621): stdout: | (launched: 2022-12-10_01:50:35.990515) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:50:37.482358 run osmo-stp_10.42.42.5(pid=10621): stderr: | 20221210015036160 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015036160 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015036160 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015036161 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015036161 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015036161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015036161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:50:37.612258 run osmo-stp_10.42.42.5(pid=10621): stdout: | (launched: 2022-12-10_01:50:35.990515) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:50:37.736517 run osmo-stp_10.42.42.5(pid=10621): stderr: | 20221210015036160 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015036160 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015036160 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015036161 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015036161 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015036161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015036161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:50:37.883696 run patchelf(pid=10624): Terminating (SIGINT) 01:50:38.052878 run patchelf(pid=10624): Terminated: ok {rc=0} 01:50:38.175859 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10621): Process ended prematurely: osmo-stp_10.42.42.5(pid=10621) [trial-2367↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10621)] [trial-2367↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 01:50:38.185366 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 01:50:38.213220 run osmo-hlr_10.42.42.2(pid=10618): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10618)] 01:50:38.260703 run osmo-hlr_10.42.42.2(pid=10618): stdout: | (launched: 2022-12-10_01:50:35.056460) 01:50:38.309743 run osmo-hlr_10.42.42.2(pid=10618): stderr: | 20221210015035234 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015035234 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015035234 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015035234 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015035234 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015035234 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015035246 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015035255 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015035255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015035255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:50:38.359147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10611): Terminating (SIGTERM) 01:50:38.398956 run iperf3-srv_10.42.42.10(pid=10612): Terminating (SIGTERM) 01:50:38.438452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10613): Terminating (SIGTERM) 01:50:38.478048 run iperf3-srv_10.42.42.10(pid=10614): Terminating (SIGTERM) 01:50:38.517434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10617): Terminating (SIGTERM) 01:50:38.557323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10620): Terminating (SIGTERM) 01:50:38.597270 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10623): Terminating (SIGTERM) 01:50:38.636874 --- ParallelTerminationStrategy: PID 10611 died... 01:50:38.655714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10611): Terminated: ok {rc=0} 01:50:38.699778 --- ParallelTerminationStrategy: PID 10612 died... 01:50:38.718294 run iperf3-srv_10.42.42.10(pid=10612): Terminated {rc=256} 01:50:38.761884 --- ParallelTerminationStrategy: PID 10613 died... 01:50:38.780456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10613): Terminated: ok {rc=0} 01:50:38.824144 --- ParallelTerminationStrategy: PID 10614 died... 01:50:38.842450 run iperf3-srv_10.42.42.10(pid=10614): Terminated {rc=256} 01:50:38.886142 --- ParallelTerminationStrategy: PID 10617 died... 01:50:38.904362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10617): Terminated: ok {rc=0} 01:50:38.948086 --- ParallelTerminationStrategy: PID 10620 died... 01:50:38.966642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10620): Terminated: ok {rc=0} 01:50:39.010275 --- ParallelTerminationStrategy: PID 10623 died... 01:50:39.028819 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10623): Terminated: ok {rc=0} 01:50:39.113500 bus /gobi_0: Setting Powered False 01:50:40.212404 bus /gobi_0: Setting Powered False 01:50:41.326726 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 01:50:42.472815 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:42.484453 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:50:42.545771 tst iperf3.py: using LAC 25156 01:50:42.674502 tst iperf3.py: using RAC 166 01:50:42.801299 tst iperf3.py: using CellId 25156 01:50:42.921258 tst iperf3.py: using BVCI 25157 01:50:43.032892 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:43.044016 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:43.054881 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:43.066534 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:43.078039 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:43.090090 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:43.101764 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:43.112183 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:43.123636 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:50:43.237831 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:50:43.440250 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:50:43.742791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10625): Launched 01:50:44.006028 run iperf3-srv_10.42.42.10(pid=10626): Launched 01:50:44.119733 tst iperf3.py:8: start network... 01:50:44.321218 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:50:44.787432 run create_hlr_db(pid=10627): Launched 01:50:44.902166 bus /gobi_6: Setting Powered False 01:50:45.966130 run create_hlr_db(pid=10627): Terminated: ok {rc=0} 01:50:46.402422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10629): Launched 01:50:46.712931 run osmo-hlr_10.42.42.2(pid=10630): Launched 01:50:46.951037 run osmo-stp_10.42.42.5: Starting osmo-stp 01:50:47.601686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10632): Launched 01:50:47.926918 run osmo-stp_10.42.42.5(pid=10633): Launched 01:50:48.051117 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:50:48.610911 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10635): Launched 01:50:48.734452 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:50:49.007211 run patchelf(pid=10636): Launched 01:50:49.186324 run osmo-stp_10.42.42.5(pid=10633): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10633)] 01:50:49.322081 run osmo-stp_10.42.42.5(pid=10633): stdout: | (launched: 2022-12-10_01:50:47.867351) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:50:49.459352 run osmo-stp_10.42.42.5(pid=10633): stderr: | 20221210015048059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015048060 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015048060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015048060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015048061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015048061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015048061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:50:49.597356 run osmo-stp_10.42.42.5(pid=10633): stdout: | (launched: 2022-12-10_01:50:47.867351) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:50:49.729771 run osmo-stp_10.42.42.5(pid=10633): stderr: | 20221210015048059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015048060 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015048060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015048060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015048061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015048061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015048061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:50:49.885759 run patchelf(pid=10636): Terminating (SIGINT) 01:50:50.065257 run patchelf(pid=10636): Terminated: ok {rc=0} 01:50:50.194654 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10633): Process ended prematurely: osmo-stp_10.42.42.5(pid=10633) [trial-2367↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10633)] [trial-2367↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 01:50:50.204757 tst iperf3.py:8: Test FAILED (7.8 sec) 01:50:50.233870 run osmo-hlr_10.42.42.2(pid=10630): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10630)] 01:50:50.283907 run osmo-hlr_10.42.42.2(pid=10630): stdout: | (launched: 2022-12-10_01:50:46.653646) 01:50:50.335416 run osmo-hlr_10.42.42.2(pid=10630): stderr: | 20221210015046876 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015046876 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015046876 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015046876 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015046876 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015046876 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015046892 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015046911 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015046911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015046911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:50:50.387523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10625): Terminating (SIGTERM) 01:50:50.429341 run iperf3-srv_10.42.42.10(pid=10626): Terminating (SIGTERM) 01:50:50.471107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10629): Terminating (SIGTERM) 01:50:50.512669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10632): Terminating (SIGTERM) 01:50:50.554635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10635): Terminating (SIGTERM) 01:50:50.596875 --- ParallelTerminationStrategy: PID 10625 died... 01:50:50.617031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10625): Terminated: ok {rc=0} 01:50:50.663274 --- ParallelTerminationStrategy: PID 10626 died... 01:50:50.682779 run iperf3-srv_10.42.42.10(pid=10626): Terminated {rc=256} 01:50:50.728681 --- ParallelTerminationStrategy: PID 10629 died... 01:50:50.748359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10629): Terminated: ok {rc=0} 01:50:50.794467 --- ParallelTerminationStrategy: PID 10632 died... 01:50:50.814098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10632): Terminated: ok {rc=0} 01:50:50.860392 --- ParallelTerminationStrategy: PID 10635 died... 01:50:50.880137 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10635): Terminated: ok {rc=0} 01:50:50.968832 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 01:50:52.118752 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:52.131073 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:50:52.181947 tst iperf3m4.py: using LAC 25157 01:50:52.309512 tst iperf3m4.py: using RAC 167 01:50:52.429201 tst iperf3m4.py: using CellId 25157 01:50:52.548262 tst iperf3m4.py: using BVCI 25158 01:50:52.657024 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:52.668164 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:52.678928 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:52.690157 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:52.700865 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:52.711666 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:52.722796 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:52.733633 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:52.744475 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:50:52.864581 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:50:52.983742 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:50:53.104780 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:50:53.223247 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:50:53.442605 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:50:53.768821 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10637): Launched 01:50:54.051075 run iperf3-srv_10.42.42.10(pid=10638): Launched 01:50:54.172593 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:50:54.390718 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:50:54.715492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10639): Launched 01:50:54.996011 run iperf3-srv_10.42.42.10(pid=10640): Launched 01:50:55.118165 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:50:55.336304 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:50:55.662768 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10641): Launched 01:50:55.944544 run iperf3-srv_10.42.42.10(pid=10642): Launched 01:50:56.066483 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:50:56.284465 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:50:56.609673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10643): Launched 01:50:56.891499 run iperf3-srv_10.42.42.10(pid=10644): Launched 01:50:57.012896 tst iperf3m4.py:8: start network... 01:50:57.229697 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:50:57.732783 run create_hlr_db(pid=10645): Launched 01:50:57.864372 bus /gobi_6: Setting Powered False 01:50:58.928751 run create_hlr_db(pid=10645): Terminated: ok {rc=0} 01:50:59.360281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10647): Launched 01:50:59.665689 run osmo-hlr_10.42.42.2(pid=10648): Launched 01:50:59.783513 run osmo-stp_10.42.42.5: Starting osmo-stp 01:51:00.310599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10650): Launched 01:51:00.611798 run osmo-stp_10.42.42.5(pid=10651): Launched 01:51:00.727216 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:51:01.253832 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10653): Launched 01:51:01.382644 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:51:01.655212 run patchelf(pid=10654): Launched 01:51:01.833370 run osmo-stp_10.42.42.5(pid=10651): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10651)] 01:51:01.964012 run osmo-stp_10.42.42.5(pid=10651): stdout: | (launched: 2022-12-10_01:51:00.555797) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:51:02.095733 run osmo-stp_10.42.42.5(pid=10651): stderr: | 20221210015100723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015100723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015100723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015100724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015100724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015100724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015100725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:51:02.227313 run osmo-stp_10.42.42.5(pid=10651): stdout: | (launched: 2022-12-10_01:51:00.555797) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:51:02.351473 run osmo-stp_10.42.42.5(pid=10651): stderr: | 20221210015100723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015100723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015100723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015100724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015100724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015100724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015100725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:51:02.497802 run patchelf(pid=10654): Terminating (SIGINT) 01:51:02.666760 run patchelf(pid=10654): Terminated: ok {rc=0} 01:51:02.788210 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10651): Process ended prematurely: osmo-stp_10.42.42.5(pid=10651) [trial-2367↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10651)] [trial-2367↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 01:51:02.797887 tst iperf3m4.py:8: Test FAILED (10.7 sec) 01:51:02.826263 run osmo-hlr_10.42.42.2(pid=10648): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10648)] 01:51:02.874093 run osmo-hlr_10.42.42.2(pid=10648): stdout: | (launched: 2022-12-10_01:50:59.608890) 01:51:02.923760 run osmo-hlr_10.42.42.2(pid=10648): stderr: | 20221210015059784 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015059784 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015059784 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015059784 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015059784 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015059784 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015059797 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015059806 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015059807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015059807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:51:02.973669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10637): Terminating (SIGTERM) 01:51:03.013581 run iperf3-srv_10.42.42.10(pid=10638): Terminating (SIGTERM) 01:51:03.053391 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10639): Terminating (SIGTERM) 01:51:03.093392 run iperf3-srv_10.42.42.10(pid=10640): Terminating (SIGTERM) 01:51:03.133159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10641): Terminating (SIGTERM) 01:51:03.172859 run iperf3-srv_10.42.42.10(pid=10642): Terminating (SIGTERM) 01:51:03.212501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10643): Terminating (SIGTERM) 01:51:03.252240 run iperf3-srv_10.42.42.10(pid=10644): Terminating (SIGTERM) 01:51:03.291750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10647): Terminating (SIGTERM) 01:51:03.331441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10650): Terminating (SIGTERM) 01:51:03.371305 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10653): Terminating (SIGTERM) 01:51:03.411239 --- ParallelTerminationStrategy: PID 10637 died... 01:51:03.430750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10637): Terminated: ok {rc=0} 01:51:03.475233 --- ParallelTerminationStrategy: PID 10638 died... 01:51:03.493884 run iperf3-srv_10.42.42.10(pid=10638): Terminated {rc=256} 01:51:03.538147 --- ParallelTerminationStrategy: PID 10639 died... 01:51:03.556656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10639): Terminated: ok {rc=0} 01:51:03.600894 --- ParallelTerminationStrategy: PID 10640 died... 01:51:03.619818 run iperf3-srv_10.42.42.10(pid=10640): Terminated {rc=256} 01:51:03.664471 --- ParallelTerminationStrategy: PID 10641 died... 01:51:03.683267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10641): Terminated: ok {rc=0} 01:51:03.727553 --- ParallelTerminationStrategy: PID 10642 died... 01:51:03.746144 run iperf3-srv_10.42.42.10(pid=10642): Terminated {rc=256} 01:51:03.790476 --- ParallelTerminationStrategy: PID 10643 died... 01:51:03.808912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10643): Terminated: ok {rc=0} 01:51:03.853650 --- ParallelTerminationStrategy: PID 10644 died... 01:51:03.872433 run iperf3-srv_10.42.42.10(pid=10644): Terminated {rc=256} 01:51:03.916661 --- ParallelTerminationStrategy: PID 10647 died... 01:51:03.935392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10647): Terminated: ok {rc=0} 01:51:03.979796 --- ParallelTerminationStrategy: PID 10650 died... 01:51:03.998474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10650): Terminated: ok {rc=0} 01:51:04.042909 --- ParallelTerminationStrategy: PID 10653 died... 01:51:04.061621 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10653): Terminated: ok {rc=0} 01:51:04.147571 bus /gobi_4: Setting Powered False 01:51:05.247532 bus /gobi_4: Setting Powered False 01:51:06.364738 bus /gobi_1: Setting Powered False 01:51:07.462558 bus /gobi_1: Setting Powered False 01:51:08.579436 bus /gobi_0: Setting Powered False 01:51:09.679408 bus /gobi_0: Setting Powered False 01:51:10.795518 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 01:51:11.898201 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:11.910509 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:51:11.961614 tst ping.py: using LAC 25158 01:51:12.087339 tst ping.py: using RAC 168 01:51:12.214047 tst ping.py: using CellId 25158 01:51:12.340334 tst ping.py: using BVCI 25159 01:51:12.456334 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:12.467984 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:12.479419 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:12.490864 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:12.502183 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:12.513276 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:12.524811 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:12.536147 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:51:12.655440 tst ping.py:19: start network... 01:51:12.869399 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:51:13.362083 run create_hlr_db(pid=10655): Launched 01:51:13.491335 bus /gobi_6: Setting Powered False 01:51:14.553906 run create_hlr_db(pid=10655): Terminated: ok {rc=0} 01:51:14.997851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10657): Launched 01:51:15.316619 run osmo-hlr_10.42.42.2(pid=10658): Launched 01:51:15.438351 run osmo-stp_10.42.42.5: Starting osmo-stp 01:51:16.009795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10660): Launched 01:51:16.330936 run osmo-stp_10.42.42.5(pid=10661): Launched 01:51:16.566421 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:51:17.272811 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10663): Launched 01:51:17.394226 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:51:17.662297 run patchelf(pid=10664): Launched 01:51:17.839676 run osmo-stp_10.42.42.5(pid=10661): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10661)] 01:51:17.973807 run osmo-stp_10.42.42.5(pid=10661): stdout: | (launched: 2022-12-10_01:51:16.268555) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:51:18.109817 run osmo-stp_10.42.42.5(pid=10661): stderr: | 20221210015116578 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015116578 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015116578 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015116579 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015116579 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015116579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015116579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:51:18.245619 run osmo-stp_10.42.42.5(pid=10661): stdout: | (launched: 2022-12-10_01:51:16.268555) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:51:18.376353 run osmo-stp_10.42.42.5(pid=10661): stderr: | 20221210015116578 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015116578 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015116578 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015116579 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015116579 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015116579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015116579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:51:18.530997 run patchelf(pid=10664): Terminating (SIGINT) 01:51:18.708777 run patchelf(pid=10664): Terminated: ok {rc=0} 01:51:18.838104 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10661): Process ended prematurely: osmo-stp_10.42.42.5(pid=10661) [trial-2367↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10661)] [trial-2367↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 01:51:18.847808 tst ping.py:22: Test FAILED (6.9 sec) 01:51:18.876198 run osmo-hlr_10.42.42.2(pid=10658): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10658)] 01:51:18.926002 run osmo-hlr_10.42.42.2(pid=10658): stdout: | (launched: 2022-12-10_01:51:15.258054) 01:51:18.977878 run osmo-hlr_10.42.42.2(pid=10658): stderr: | 20221210015115455 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015115455 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015115455 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015115455 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015115455 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015115455 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015115471 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015115481 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015115482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015115482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:51:19.030086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10657): Terminating (SIGTERM) 01:51:19.071619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10660): Terminating (SIGTERM) 01:51:19.113402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10663): Terminating (SIGTERM) 01:51:19.155351 --- ParallelTerminationStrategy: PID 10657 died... 01:51:19.175282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10657): Terminated: ok {rc=0} 01:51:19.221619 --- ParallelTerminationStrategy: PID 10660 died... 01:51:19.241228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10660): Terminated: ok {rc=0} 01:51:19.286884 --- ParallelTerminationStrategy: PID 10663 died... 01:51:19.306475 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10663): Terminated: ok {rc=0} 01:51:19.393553 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 01:51:20.480390 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:20.493284 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:51:20.543453 tst ping_idle_ping.py: using LAC 25159 01:51:20.668840 tst ping_idle_ping.py: using RAC 169 01:51:20.793205 tst ping_idle_ping.py: using CellId 25159 01:51:20.917371 tst ping_idle_ping.py: using BVCI 25160 01:51:21.032887 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:21.044419 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:21.055780 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:21.067137 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:21.078528 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:21.089716 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:21.101222 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:21.112522 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:51:21.229711 tst ping_idle_ping.py:24: start network... 01:51:21.443060 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:51:21.939849 run create_hlr_db(pid=10665): Launched 01:51:22.071099 bus /gobi_6: Setting Powered False 01:51:23.134427 run create_hlr_db(pid=10665): Terminated: ok {rc=0} 01:51:23.559671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10667): Launched 01:51:23.859509 run osmo-hlr_10.42.42.2(pid=10668): Launched 01:51:23.974708 run osmo-stp_10.42.42.5: Starting osmo-stp 01:51:24.499643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10670): Launched 01:51:24.796790 run osmo-stp_10.42.42.5(pid=10671): Launched 01:51:24.910349 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:51:25.426353 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10673): Launched 01:51:25.539821 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:51:25.790788 run patchelf(pid=10674): Launched 01:51:25.957106 run osmo-stp_10.42.42.5(pid=10671): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10671)] 01:51:26.082363 run osmo-stp_10.42.42.5(pid=10671): stdout: | (launched: 2022-12-10_01:51:24.741864) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:51:26.209113 run osmo-stp_10.42.42.5(pid=10671): stderr: | 20221210015124915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015124916 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015124916 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015124916 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015124917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015124917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015124917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:51:26.335851 run osmo-stp_10.42.42.5(pid=10671): stdout: | (launched: 2022-12-10_01:51:24.741864) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:51:26.457276 run osmo-stp_10.42.42.5(pid=10671): stderr: | 20221210015124915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015124916 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015124916 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015124916 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015124917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015124917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015124917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:51:26.601114 run patchelf(pid=10674): Terminating (SIGINT) 01:51:26.767461 run patchelf(pid=10674): Terminated: ok {rc=0} 01:51:26.886842 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10671): Process ended prematurely: osmo-stp_10.42.42.5(pid=10671) [trial-2367↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10671)] [trial-2367↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 01:51:26.895668 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 01:51:26.922885 run osmo-hlr_10.42.42.2(pid=10668): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10668)] 01:51:26.970130 run osmo-hlr_10.42.42.2(pid=10668): stdout: | (launched: 2022-12-10_01:51:23.803593) 01:51:27.019234 run osmo-hlr_10.42.42.2(pid=10668): stderr: | 20221210015123977 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015123977 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015123977 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015123977 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015123978 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015123978 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015123988 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015123997 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015123997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015123997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:51:27.068689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10667): Terminating (SIGTERM) 01:51:27.108169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10670): Terminating (SIGTERM) 01:51:27.147718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10673): Terminating (SIGTERM) 01:51:27.187439 --- ParallelTerminationStrategy: PID 10667 died... 01:51:27.205997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10667): Terminated: ok {rc=0} 01:51:27.250232 --- ParallelTerminationStrategy: PID 10670 died... 01:51:27.268810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10670): Terminated: ok {rc=0} 01:51:27.313264 --- ParallelTerminationStrategy: PID 10673 died... 01:51:27.331764 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10673): Terminated: ok {rc=0} 01:51:27.414866 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 01:51:28.724008 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:51:28.732200 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 01:51:28.764461 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 01:51:28.802254 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 01:51:28.888087 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 01:51:28.920369 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 01:51:28.958570 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 01:51:29.553427 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 01:51:29.602744 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:29.613623 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:51:29.679148 tst cs_paging_gprs_active.py: using LAC 25160 01:51:29.797358 tst cs_paging_gprs_active.py: using RAC 170 01:51:29.925433 tst cs_paging_gprs_active.py: using CellId 25160 01:51:30.054114 tst cs_paging_gprs_active.py: using BVCI 25161 01:51:30.173495 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:30.184925 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:30.196335 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:30.208244 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:30.220058 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:30.231763 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:30.243515 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:30.255061 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:30.266819 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:51:30.383650 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:51:30.501863 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:51:30.720498 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:51:31.067631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10679): Launched 01:51:31.347694 run iperf3-srv_10.42.42.10(pid=10680): Launched 01:51:31.478737 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:51:31.700351 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:51:32.033941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10681): Launched 01:51:32.329925 run iperf3-srv_10.42.42.10(pid=10682): Launched 01:51:32.443707 tst cs_paging_gprs_active.py:38: start network... 01:51:32.645607 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:51:33.113661 run create_hlr_db(pid=10683): Launched 01:51:33.230303 bus /gobi_6: Setting Powered False 01:51:34.290516 run create_hlr_db(pid=10683): Terminated: ok {rc=0} 01:51:34.730981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10686): Launched 01:51:35.054201 run osmo-hlr_10.42.42.2(pid=10687): Launched 01:51:35.178364 run osmo-stp_10.42.42.5: Starting osmo-stp 01:51:35.739139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10689): Launched 01:51:36.062697 run osmo-stp_10.42.42.5(pid=10690): Launched 01:51:36.186486 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:51:36.743404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10692): Launched 01:51:36.866790 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:51:37.140274 run patchelf(pid=10693): Launched 01:51:37.319630 run osmo-stp_10.42.42.5(pid=10690): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10690)] 01:51:37.455882 run osmo-stp_10.42.42.5(pid=10690): stdout: | (launched: 2022-12-10_01:51:36.003546) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:51:37.593973 run osmo-stp_10.42.42.5(pid=10690): stderr: | 20221210015136194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015136194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015136195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015136195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015136195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015136196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015136196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:51:37.731610 run osmo-stp_10.42.42.5(pid=10690): stdout: | (launched: 2022-12-10_01:51:36.003546) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:51:37.863547 run osmo-stp_10.42.42.5(pid=10690): stderr: | 20221210015136194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015136194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015136195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015136195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015136195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015136196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015136196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:51:38.020071 run patchelf(pid=10693): Terminating (SIGINT) 01:51:38.199452 run patchelf(pid=10693): Terminated: ok {rc=0} 01:51:38.329281 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10690): Process ended prematurely: osmo-stp_10.42.42.5(pid=10690) [trial-2367↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10690)] [trial-2367↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 01:51:38.339224 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 01:51:38.367470 run osmo-hlr_10.42.42.2(pid=10687): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10687)] 01:51:38.417132 run osmo-hlr_10.42.42.2(pid=10687): stdout: | (launched: 2022-12-10_01:51:34.995354) 01:51:38.468434 run osmo-hlr_10.42.42.2(pid=10687): stderr: | 20221210015135191 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015135192 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015135192 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015135192 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015135192 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015135192 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015135206 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015135214 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015135214 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015135214 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:51:38.520231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10679): Terminating (SIGTERM) 01:51:38.561823 run iperf3-srv_10.42.42.10(pid=10680): Terminating (SIGTERM) 01:51:38.603559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10681): Terminating (SIGTERM) 01:51:38.645163 run iperf3-srv_10.42.42.10(pid=10682): Terminating (SIGTERM) 01:51:38.686611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10686): Terminating (SIGTERM) 01:51:38.728088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10689): Terminating (SIGTERM) 01:51:38.769539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10692): Terminating (SIGTERM) 01:51:38.811428 --- ParallelTerminationStrategy: PID 10679 died... 01:51:38.831399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10679): Terminated: ok {rc=0} 01:51:38.877208 --- ParallelTerminationStrategy: PID 10680 died... 01:51:38.896403 run iperf3-srv_10.42.42.10(pid=10680): Terminated {rc=256} 01:51:38.942121 --- ParallelTerminationStrategy: PID 10681 died... 01:51:38.961501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10681): Terminated: ok {rc=0} 01:51:39.006930 --- ParallelTerminationStrategy: PID 10682 died... 01:51:39.026229 run iperf3-srv_10.42.42.10(pid=10682): Terminated {rc=256} 01:51:39.071499 --- ParallelTerminationStrategy: PID 10686 died... 01:51:39.090914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10686): Terminated: ok {rc=0} 01:51:39.136368 --- ParallelTerminationStrategy: PID 10689 died... 01:51:39.155965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10689): Terminated: ok {rc=0} 01:51:39.201450 --- ParallelTerminationStrategy: PID 10692 died... 01:51:39.220865 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10692): Terminated: ok {rc=0} 01:51:39.307894 bus /gobi_0: Setting Powered False 01:51:40.407093 bus /gobi_0: Setting Powered False 01:51:41.521494 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 01:51:42.670989 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:42.683172 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:51:42.753618 tst iperf3.py: using LAC 25161 01:51:42.881408 tst iperf3.py: using RAC 171 01:51:43.007698 tst iperf3.py: using CellId 25161 01:51:43.137148 tst iperf3.py: using BVCI 25162 01:51:43.256031 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:43.267511 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:43.278807 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:43.290144 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:43.301335 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:43.312516 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:43.323825 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:43.334904 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:43.346167 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:51:43.460437 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:51:43.664544 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:51:43.966992 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10694): Launched 01:51:44.231399 run iperf3-srv_10.42.42.10(pid=10695): Launched 01:51:44.345630 tst iperf3.py:8: start network... 01:51:44.547011 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:51:45.015202 run create_hlr_db(pid=10696): Launched 01:51:45.131355 bus /gobi_6: Setting Powered False 01:51:46.191095 run create_hlr_db(pid=10696): Terminated: ok {rc=0} 01:51:46.627969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10698): Launched 01:51:46.951523 run osmo-hlr_10.42.42.2(pid=10699): Launched 01:51:47.169332 run osmo-stp_10.42.42.5: Starting osmo-stp 01:51:47.708102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10701): Launched 01:51:48.009990 run osmo-stp_10.42.42.5(pid=10702): Launched 01:51:48.125112 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:51:48.645775 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10704): Launched 01:51:48.762084 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:51:49.018923 run patchelf(pid=10705): Launched 01:51:49.187249 run osmo-stp_10.42.42.5(pid=10702): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10702)] 01:51:49.314254 run osmo-stp_10.42.42.5(pid=10702): stdout: | (launched: 2022-12-10_01:51:47.953996) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:51:49.442653 run osmo-stp_10.42.42.5(pid=10702): stderr: | 20221210015148123 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015148124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015148124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015148124 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015148126 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015148127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015148127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:51:49.571542 run osmo-stp_10.42.42.5(pid=10702): stdout: | (launched: 2022-12-10_01:51:47.953996) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:51:49.695213 run osmo-stp_10.42.42.5(pid=10702): stderr: | 20221210015148123 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015148124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015148124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015148124 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015148126 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015148127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015148127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:51:49.841634 run patchelf(pid=10705): Terminating (SIGINT) 01:51:50.010121 run patchelf(pid=10705): Terminated: ok {rc=0} 01:51:50.132724 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10702): Process ended prematurely: osmo-stp_10.42.42.5(pid=10702) [trial-2367↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10702)] [trial-2367↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 01:51:50.142567 tst iperf3.py:8: Test FAILED (7.5 sec) 01:51:50.170429 run osmo-hlr_10.42.42.2(pid=10699): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10699)] 01:51:50.217942 run osmo-hlr_10.42.42.2(pid=10699): stdout: | (launched: 2022-12-10_01:51:46.881129) 01:51:50.267396 run osmo-hlr_10.42.42.2(pid=10699): stderr: | 20221210015147236 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015147236 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015147236 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015147236 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015147236 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015147236 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015147260 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015147269 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015147269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015147269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:51:50.317370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10694): Terminating (SIGTERM) 01:51:50.357379 run iperf3-srv_10.42.42.10(pid=10695): Terminating (SIGTERM) 01:51:50.397111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10698): Terminating (SIGTERM) 01:51:50.437111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10701): Terminating (SIGTERM) 01:51:50.476769 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10704): Terminating (SIGTERM) 01:51:50.516851 --- ParallelTerminationStrategy: PID 10694 died... 01:51:50.535807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10694): Terminated: ok {rc=0} 01:51:50.580835 --- ParallelTerminationStrategy: PID 10695 died... 01:51:50.599521 run iperf3-srv_10.42.42.10(pid=10695): Terminated {rc=256} 01:51:50.643763 --- ParallelTerminationStrategy: PID 10698 died... 01:51:50.662399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10698): Terminated: ok {rc=0} 01:51:50.706352 --- ParallelTerminationStrategy: PID 10701 died... 01:51:50.725145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10701): Terminated: ok {rc=0} 01:51:50.769320 --- ParallelTerminationStrategy: PID 10704 died... 01:51:50.787858 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10704): Terminated: ok {rc=0} 01:51:50.874527 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 01:51:52.020267 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:52.032120 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:51:52.099500 tst iperf3m4.py: using LAC 25162 01:51:52.217595 tst iperf3m4.py: using RAC 172 01:51:52.348361 tst iperf3m4.py: using CellId 25162 01:51:52.472716 tst iperf3m4.py: using BVCI 25163 01:51:52.589941 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:52.601364 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:52.612877 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:52.624125 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:52.635366 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:52.646593 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:52.657904 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:52.669048 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:52.680217 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:51:52.797360 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:51:52.915371 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:51:53.034450 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:51:53.151190 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:51:53.354416 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:51:53.658184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10706): Launched 01:51:53.922654 run iperf3-srv_10.42.42.10(pid=10707): Launched 01:51:54.036322 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:51:54.238825 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:51:54.542033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10708): Launched 01:51:54.807024 run iperf3-srv_10.42.42.10(pid=10709): Launched 01:51:54.920618 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:51:55.121892 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:51:55.425399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10710): Launched 01:51:55.690559 run iperf3-srv_10.42.42.10(pid=10711): Launched 01:51:55.813376 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:51:56.030741 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:51:56.356514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10712): Launched 01:51:56.638767 run iperf3-srv_10.42.42.10(pid=10713): Launched 01:51:56.760537 tst iperf3m4.py:8: start network... 01:51:56.977481 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:51:57.478485 run create_hlr_db(pid=10714): Launched 01:51:57.610746 bus /gobi_6: Setting Powered False 01:51:58.674627 run create_hlr_db(pid=10714): Terminated: ok {rc=0} 01:51:59.123538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10716): Launched 01:51:59.446879 run osmo-hlr_10.42.42.2(pid=10717): Launched 01:51:59.570115 run osmo-stp_10.42.42.5: Starting osmo-stp 01:52:00.126344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10719): Launched 01:52:00.450966 run osmo-stp_10.42.42.5(pid=10720): Launched 01:52:00.574729 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:52:01.161917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10722): Launched 01:52:01.288889 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:52:01.580370 run patchelf(pid=10723): Launched 01:52:01.795609 run osmo-stp_10.42.42.5(pid=10720): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10720)] 01:52:01.956276 run osmo-stp_10.42.42.5(pid=10720): stdout: | (launched: 2022-12-10_01:52:00.391446) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:52:02.098585 run osmo-stp_10.42.42.5(pid=10720): stderr: | 20221210015200580 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015200580 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015200580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015200580 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015200581 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015200581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015200581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:52:02.239412 run osmo-stp_10.42.42.5(pid=10720): stdout: | (launched: 2022-12-10_01:52:00.391446) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:52:02.371960 run osmo-stp_10.42.42.5(pid=10720): stderr: | 20221210015200580 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015200580 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015200580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015200580 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015200581 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015200581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015200581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:52:02.529230 run patchelf(pid=10723): Terminating (SIGINT) 01:52:02.710239 run patchelf(pid=10723): Terminated: ok {rc=0} 01:52:02.839994 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10720): Process ended prematurely: osmo-stp_10.42.42.5(pid=10720) [trial-2367↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10720)] [trial-2367↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 01:52:02.850183 tst iperf3m4.py:8: Test FAILED (10.9 sec) 01:52:02.879035 run osmo-hlr_10.42.42.2(pid=10717): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10717)] 01:52:02.928783 run osmo-hlr_10.42.42.2(pid=10717): stdout: | (launched: 2022-12-10_01:51:59.387461) 01:52:02.980180 run osmo-hlr_10.42.42.2(pid=10717): stderr: | 20221210015159584 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015159584 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015159584 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015159584 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015159584 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015159584 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015159597 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015159606 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015159606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015159606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:52:03.032101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10706): Terminating (SIGTERM) 01:52:03.073773 run iperf3-srv_10.42.42.10(pid=10707): Terminating (SIGTERM) 01:52:03.115354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10708): Terminating (SIGTERM) 01:52:03.156868 run iperf3-srv_10.42.42.10(pid=10709): Terminating (SIGTERM) 01:52:03.198159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10710): Terminating (SIGTERM) 01:52:03.239552 run iperf3-srv_10.42.42.10(pid=10711): Terminating (SIGTERM) 01:52:03.280849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10712): Terminating (SIGTERM) 01:52:03.322406 run iperf3-srv_10.42.42.10(pid=10713): Terminating (SIGTERM) 01:52:03.363673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10716): Terminating (SIGTERM) 01:52:03.405131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10719): Terminating (SIGTERM) 01:52:03.446916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10722): Terminating (SIGTERM) 01:52:03.489142 --- ParallelTerminationStrategy: PID 10706 died... 01:52:03.509256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10706): Terminated: ok {rc=0} 01:52:03.555708 --- ParallelTerminationStrategy: PID 10707 died... 01:52:03.575396 run iperf3-srv_10.42.42.10(pid=10707): Terminated {rc=256} 01:52:03.621726 --- ParallelTerminationStrategy: PID 10708 died... 01:52:03.641569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10708): Terminated: ok {rc=0} 01:52:03.687890 --- ParallelTerminationStrategy: PID 10709 died... 01:52:03.707587 run iperf3-srv_10.42.42.10(pid=10709): Terminated {rc=256} 01:52:03.753733 --- ParallelTerminationStrategy: PID 10710 died... 01:52:03.773467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10710): Terminated: ok {rc=0} 01:52:03.819722 --- ParallelTerminationStrategy: PID 10711 died... 01:52:03.839430 run iperf3-srv_10.42.42.10(pid=10711): Terminated {rc=256} 01:52:03.885484 --- ParallelTerminationStrategy: PID 10712 died... 01:52:03.905316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10712): Terminated: ok {rc=0} 01:52:03.951584 --- ParallelTerminationStrategy: PID 10713 died... 01:52:03.971305 run iperf3-srv_10.42.42.10(pid=10713): Terminated {rc=256} 01:52:04.017418 --- ParallelTerminationStrategy: PID 10716 died... 01:52:04.036874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10716): Terminated: ok {rc=0} 01:52:04.083382 --- ParallelTerminationStrategy: PID 10719 died... 01:52:04.103166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10719): Terminated: ok {rc=0} 01:52:04.149677 --- ParallelTerminationStrategy: PID 10722 died... 01:52:04.169700 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10722): Terminated: ok {rc=0} 01:52:04.257946 bus /gobi_4: Setting Powered False 01:52:05.358089 bus /gobi_4: Setting Powered False 01:52:06.474771 bus /gobi_1: Setting Powered False 01:52:07.571832 bus /gobi_1: Setting Powered False 01:52:08.687920 bus /gobi_0: Setting Powered False 01:52:09.785090 bus /gobi_0: Setting Powered False 01:52:10.901419 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 01:52:12.004721 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:12.016464 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:52:12.084171 tst ping.py: using LAC 25163 01:52:12.200577 tst ping.py: using RAC 173 01:52:12.326230 tst ping.py: using CellId 25163 01:52:12.453066 tst ping.py: using BVCI 25164 01:52:12.568489 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:12.580060 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:12.591245 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:12.603212 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:12.614398 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:12.625712 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:12.637448 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:12.648580 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:52:12.766310 tst ping.py:19: start network... 01:52:12.980260 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:52:13.472878 run create_hlr_db(pid=10724): Launched 01:52:13.603146 bus /gobi_6: Setting Powered False 01:52:14.662387 run create_hlr_db(pid=10724): Terminated: ok {rc=0} 01:52:15.106385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10726): Launched 01:52:15.426993 run osmo-hlr_10.42.42.2(pid=10727): Launched 01:52:15.548717 run osmo-stp_10.42.42.5: Starting osmo-stp 01:52:16.127902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10729): Launched 01:52:16.482416 run osmo-stp_10.42.42.5(pid=10730): Launched 01:52:16.694721 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:52:17.434919 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10732): Launched 01:52:17.556795 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:52:17.825930 run patchelf(pid=10733): Launched 01:52:18.003981 run osmo-stp_10.42.42.5(pid=10730): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10730)] 01:52:18.138238 run osmo-stp_10.42.42.5(pid=10730): stdout: | (launched: 2022-12-10_01:52:16.408840) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:52:18.274357 run osmo-stp_10.42.42.5(pid=10730): stderr: | 20221210015216700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015216700 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015216701 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015216701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015216701 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015216701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015216702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:52:18.409912 run osmo-stp_10.42.42.5(pid=10730): stdout: | (launched: 2022-12-10_01:52:16.408840) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:52:18.540526 run osmo-stp_10.42.42.5(pid=10730): stderr: | 20221210015216700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015216700 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015216701 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015216701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015216701 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015216701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015216702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:52:18.695856 run patchelf(pid=10733): Terminating (SIGINT) 01:52:18.873250 run patchelf(pid=10733): Terminated: ok {rc=0} 01:52:19.000577 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10730): Process ended prematurely: osmo-stp_10.42.42.5(pid=10730) [trial-2367↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10730)] [trial-2367↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 01:52:19.010691 tst ping.py:22: Test FAILED (7.0 sec) 01:52:19.038976 run osmo-hlr_10.42.42.2(pid=10727): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10727)] 01:52:19.088661 run osmo-hlr_10.42.42.2(pid=10727): stdout: | (launched: 2022-12-10_01:52:15.368141) 01:52:19.140295 run osmo-hlr_10.42.42.2(pid=10727): stderr: | 20221210015215564 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015215564 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015215564 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015215564 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015215564 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015215565 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015215576 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015215585 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015215585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015215585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:52:19.192297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10726): Terminating (SIGTERM) 01:52:19.233876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10729): Terminating (SIGTERM) 01:52:19.275575 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10732): Terminating (SIGTERM) 01:52:19.317864 --- ParallelTerminationStrategy: PID 10726 died... 01:52:19.338083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10726): Terminated: ok {rc=0} 01:52:19.384336 --- ParallelTerminationStrategy: PID 10729 died... 01:52:19.404038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10729): Terminated: ok {rc=0} 01:52:19.450432 --- ParallelTerminationStrategy: PID 10732 died... 01:52:19.470037 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10732): Terminated: ok {rc=0} 01:52:19.558100 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 01:52:20.647556 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:20.660129 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:52:20.729726 tst ping_idle_ping.py: using LAC 25164 01:52:20.855603 tst ping_idle_ping.py: using RAC 174 01:52:20.975598 tst ping_idle_ping.py: using CellId 25164 01:52:21.094128 tst ping_idle_ping.py: using BVCI 25165 01:52:21.204506 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:21.215619 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:21.226599 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:21.238107 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:21.249634 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:21.261061 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:21.272451 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:21.283919 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:52:21.402772 tst ping_idle_ping.py:24: start network... 01:52:21.618234 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:52:22.117380 run create_hlr_db(pid=10734): Launched 01:52:22.248461 bus /gobi_6: Setting Powered False 01:52:23.312185 run create_hlr_db(pid=10734): Terminated: ok {rc=0} 01:52:23.739530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10736): Launched 01:52:24.038768 run osmo-hlr_10.42.42.2(pid=10737): Launched 01:52:24.153474 run osmo-stp_10.42.42.5: Starting osmo-stp 01:52:24.677876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10739): Launched 01:52:24.978227 run osmo-stp_10.42.42.5(pid=10740): Launched 01:52:25.091761 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:52:25.605543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10742): Launched 01:52:25.720036 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:52:25.971568 run patchelf(pid=10743): Launched 01:52:26.137144 run osmo-stp_10.42.42.5(pid=10740): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10740)] 01:52:26.262847 run osmo-stp_10.42.42.5(pid=10740): stdout: | (launched: 2022-12-10_01:52:24.921800) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:52:26.390698 run osmo-stp_10.42.42.5(pid=10740): stderr: | 20221210015225092 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015225092 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015225093 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015225093 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015225094 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015225094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015225094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:52:26.518371 run osmo-stp_10.42.42.5(pid=10740): stdout: | (launched: 2022-12-10_01:52:24.921800) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:52:26.640720 run osmo-stp_10.42.42.5(pid=10740): stderr: | 20221210015225092 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015225092 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015225093 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015225093 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015225094 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015225094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015225094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:52:26.785561 run patchelf(pid=10743): Terminating (SIGINT) 01:52:26.951677 run patchelf(pid=10743): Terminated: ok {rc=0} 01:52:27.071468 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10740): Process ended prematurely: osmo-stp_10.42.42.5(pid=10740) [trial-2367↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10740)] [trial-2367↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 01:52:27.080398 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 01:52:27.107708 run osmo-hlr_10.42.42.2(pid=10737): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10737)] 01:52:27.155969 run osmo-hlr_10.42.42.2(pid=10737): stdout: | (launched: 2022-12-10_01:52:23.983471) 01:52:27.205124 run osmo-hlr_10.42.42.2(pid=10737): stderr: | 20221210015224157 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015224157 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015224157 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015224157 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015224157 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015224157 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015224169 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015224178 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015224178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015224178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:52:27.254631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10736): Terminating (SIGTERM) 01:52:27.294023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10739): Terminating (SIGTERM) 01:52:27.333542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10742): Terminating (SIGTERM) 01:52:27.373360 --- ParallelTerminationStrategy: PID 10736 died... 01:52:27.392174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10736): Terminated: ok {rc=0} 01:52:27.436653 --- ParallelTerminationStrategy: PID 10739 died... 01:52:27.455349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10739): Terminated: ok {rc=0} 01:52:27.499471 --- ParallelTerminationStrategy: PID 10742 died... 01:52:27.518004 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10742): Terminated: ok {rc=0} 01:52:27.600424 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 01:52:28.907956 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:52:28.915198 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 01:52:28.947762 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 01:52:28.985362 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 01:52:29.070563 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 01:52:29.101962 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 01:52:29.139420 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 01:52:29.738883 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2367 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 01:52:29.787300 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:29.798464 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:52:29.859634 tst cs_paging_gprs_active.py: using LAC 25165 01:52:29.980676 tst cs_paging_gprs_active.py: using RAC 175 01:52:30.097363 tst cs_paging_gprs_active.py: using CellId 25165 01:52:30.214539 tst cs_paging_gprs_active.py: using BVCI 25166 01:52:30.332623 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:30.344556 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:30.356391 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:30.368914 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:30.380851 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:30.392640 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:30.404743 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:30.416327 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:30.428401 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:52:30.546046 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:52:30.660607 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:52:30.889109 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:52:31.229029 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10748): Launched 01:52:31.533644 run iperf3-srv_10.42.42.10(pid=10749): Launched 01:52:31.664684 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:52:31.883115 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:52:32.194328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10750): Launched 01:52:32.476321 run iperf3-srv_10.42.42.10(pid=10751): Launched 01:52:32.597125 tst cs_paging_gprs_active.py:38: start network... 01:52:32.813070 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:52:33.311192 run create_hlr_db(pid=10752): Launched 01:52:33.441236 bus /gobi_6: Setting Powered False 01:52:34.504587 run create_hlr_db(pid=10752): Terminated: ok {rc=0} 01:52:34.949731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10754): Launched 01:52:35.269577 run osmo-hlr_10.42.42.2(pid=10755): Launched 01:52:35.392753 run osmo-stp_10.42.42.5: Starting osmo-stp 01:52:35.950572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10761): Launched 01:52:36.271074 run osmo-stp_10.42.42.5(pid=10762): Launched 01:52:36.393246 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:52:36.947349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10764): Launched 01:52:37.069812 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:52:37.339709 run patchelf(pid=10765): Launched 01:52:37.517956 run osmo-stp_10.42.42.5(pid=10762): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10762)] 01:52:37.653995 run osmo-stp_10.42.42.5(pid=10762): stdout: | (launched: 2022-12-10_01:52:36.212437) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:52:37.791155 run osmo-stp_10.42.42.5(pid=10762): stderr: | 20221210015236404 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015236404 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015236405 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015236405 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015236405 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015236406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015236406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:52:37.927914 run osmo-stp_10.42.42.5(pid=10762): stdout: | (launched: 2022-12-10_01:52:36.212437) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:52:38.059250 run osmo-stp_10.42.42.5(pid=10762): stderr: | 20221210015236404 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015236404 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015236405 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015236405 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015236405 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015236406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015236406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:52:38.214865 run patchelf(pid=10765): Terminating (SIGINT) 01:52:38.393111 run patchelf(pid=10765): Terminated: ok {rc=0} 01:52:38.522383 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10762): Process ended prematurely: osmo-stp_10.42.42.5(pid=10762) [trial-2367↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10762)] [trial-2367↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 01:52:38.532494 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 01:52:38.560713 run osmo-hlr_10.42.42.2(pid=10755): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10755)] 01:52:38.610739 run osmo-hlr_10.42.42.2(pid=10755): stdout: | (launched: 2022-12-10_01:52:35.211147) 01:52:38.662207 run osmo-hlr_10.42.42.2(pid=10755): stderr: | 20221210015235411 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015235411 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015235411 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015235411 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015235411 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015235411 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015235423 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015235431 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015235432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015235432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:52:38.713944 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10748): Terminating (SIGTERM) 01:52:38.755524 run iperf3-srv_10.42.42.10(pid=10749): Terminating (SIGTERM) 01:52:38.796766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10750): Terminating (SIGTERM) 01:52:38.838232 run iperf3-srv_10.42.42.10(pid=10751): Terminating (SIGTERM) 01:52:38.879478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10754): Terminating (SIGTERM) 01:52:38.920917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10761): Terminating (SIGTERM) 01:52:38.962240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10764): Terminating (SIGTERM) 01:52:39.003910 --- ParallelTerminationStrategy: PID 10748 died... 01:52:39.023711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10748): Terminated: ok {rc=0} 01:52:39.069333 --- ParallelTerminationStrategy: PID 10749 died... 01:52:39.088540 run iperf3-srv_10.42.42.10(pid=10749): Terminated {rc=256} 01:52:39.133884 --- ParallelTerminationStrategy: PID 10750 died... 01:52:39.153132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10750): Terminated: ok {rc=0} 01:52:39.198336 --- ParallelTerminationStrategy: PID 10751 died... 01:52:39.217509 run iperf3-srv_10.42.42.10(pid=10751): Terminated {rc=256} 01:52:39.262835 --- ParallelTerminationStrategy: PID 10754 died... 01:52:39.282037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10754): Terminated: ok {rc=0} 01:52:39.327845 --- ParallelTerminationStrategy: PID 10761 died... 01:52:39.347061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10761): Terminated: ok {rc=0} 01:52:39.392474 --- ParallelTerminationStrategy: PID 10764 died... 01:52:39.411837 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10764): Terminated: ok {rc=0} 01:52:39.498685 bus /gobi_0: Setting Powered False 01:52:40.598201 bus /gobi_0: Setting Powered False 01:52:41.713750 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 01:52:42.855681 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:42.867874 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:52:42.920636 tst iperf3.py: using LAC 25166 01:52:43.041275 tst iperf3.py: using RAC 176 01:52:43.159038 tst iperf3.py: using CellId 25166 01:52:43.275798 tst iperf3.py: using BVCI 25167 01:52:43.383773 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:43.395035 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:43.406176 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:43.417582 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:43.428858 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:43.440502 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:43.451973 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:43.463203 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:43.474812 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:52:43.590393 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:52:43.789619 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:52:44.088201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10766): Launched 01:52:44.348572 run iperf3-srv_10.42.42.10(pid=10767): Launched 01:52:44.461793 tst iperf3.py:8: start network... 01:52:44.661446 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:52:45.125801 run create_hlr_db(pid=10768): Launched 01:52:45.241084 bus /gobi_6: Setting Powered False 01:52:46.310441 run create_hlr_db(pid=10768): Terminated: ok {rc=0} 01:52:46.809776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10770): Launched 01:52:47.137759 run osmo-hlr_10.42.42.2(pid=10771): Launched 01:52:47.254091 run osmo-stp_10.42.42.5: Starting osmo-stp 01:52:47.786108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10773): Launched 01:52:48.085644 run osmo-stp_10.42.42.5(pid=10774): Launched 01:52:48.200880 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:52:48.719829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10776): Launched 01:52:48.835203 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:52:49.088357 run patchelf(pid=10777): Launched 01:52:49.255607 run osmo-stp_10.42.42.5(pid=10774): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10774)] 01:52:49.382217 run osmo-stp_10.42.42.5(pid=10774): stdout: | (launched: 2022-12-10_01:52:48.030633) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:52:49.510371 run osmo-stp_10.42.42.5(pid=10774): stderr: | 20221210015248200 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015248200 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015248200 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015248201 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015248202 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015248202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015248203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:52:49.638656 run osmo-stp_10.42.42.5(pid=10774): stdout: | (launched: 2022-12-10_01:52:48.030633) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:52:49.761445 run osmo-stp_10.42.42.5(pid=10774): stderr: | 20221210015248200 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015248200 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015248200 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015248201 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015248202 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015248202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015248203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:52:49.906826 run patchelf(pid=10777): Terminating (SIGINT) 01:52:50.074354 run patchelf(pid=10777): Terminated: ok {rc=0} 01:52:50.195236 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10774): Process ended prematurely: osmo-stp_10.42.42.5(pid=10774) [trial-2367↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10774)] [trial-2367↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 01:52:50.204675 tst iperf3.py:8: Test FAILED (7.4 sec) 01:52:50.232704 run osmo-hlr_10.42.42.2(pid=10771): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10771)] 01:52:50.280436 run osmo-hlr_10.42.42.2(pid=10771): stdout: | (launched: 2022-12-10_01:52:47.069695) 01:52:50.329505 run osmo-hlr_10.42.42.2(pid=10771): stderr: | 20221210015247279 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015247279 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015247279 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015247280 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015247280 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015247280 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015247295 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015247305 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015247306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015247306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:52:50.379058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10766): Terminating (SIGTERM) 01:52:50.418633 run iperf3-srv_10.42.42.10(pid=10767): Terminating (SIGTERM) 01:52:50.457926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10770): Terminating (SIGTERM) 01:52:50.497489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10773): Terminating (SIGTERM) 01:52:50.537327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10776): Terminating (SIGTERM) 01:52:50.577568 --- ParallelTerminationStrategy: PID 10766 died... 01:52:50.596255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10766): Terminated: ok {rc=0} 01:52:50.640060 --- ParallelTerminationStrategy: PID 10767 died... 01:52:50.658416 run iperf3-srv_10.42.42.10(pid=10767): Terminated {rc=256} 01:52:50.701652 --- ParallelTerminationStrategy: PID 10770 died... 01:52:50.720050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10770): Terminated: ok {rc=0} 01:52:50.763761 --- ParallelTerminationStrategy: PID 10773 died... 01:52:50.782234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10773): Terminated: ok {rc=0} 01:52:50.826316 --- ParallelTerminationStrategy: PID 10776 died... 01:52:50.844788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10776): Terminated: ok {rc=0} 01:52:50.930186 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 01:52:52.075880 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:52.088360 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:52:52.143225 tst iperf3m4.py: using LAC 25167 01:52:52.261601 tst iperf3m4.py: using RAC 177 01:52:52.387287 tst iperf3m4.py: using CellId 25167 01:52:52.514459 tst iperf3m4.py: using BVCI 25168 01:52:52.633190 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:52.645208 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:52.657145 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:52.669284 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:52.681026 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:52.692583 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:52.704374 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:52.716423 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:52.728402 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:52:52.846259 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:52:52.964386 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:52:53.083133 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:52:53.200848 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:52:53.418468 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:52:53.740861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10778): Launched 01:52:54.019194 run iperf3-srv_10.42.42.10(pid=10779): Launched 01:52:54.139772 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:52:54.354893 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:52:54.677264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10780): Launched 01:52:54.955969 run iperf3-srv_10.42.42.10(pid=10781): Launched 01:52:55.076619 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:52:55.291954 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:52:55.612917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10782): Launched 01:52:55.892338 run iperf3-srv_10.42.42.10(pid=10783): Launched 01:52:56.013231 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:52:56.228385 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:52:56.549682 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10784): Launched 01:52:56.830685 run iperf3-srv_10.42.42.10(pid=10785): Launched 01:52:56.950843 tst iperf3m4.py:8: start network... 01:52:57.165508 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:52:57.662188 run create_hlr_db(pid=10786): Launched 01:52:57.792168 bus /gobi_6: Setting Powered False 01:52:58.855916 run create_hlr_db(pid=10786): Terminated: ok {rc=0} 01:52:59.282371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10788): Launched 01:52:59.582485 run osmo-hlr_10.42.42.2(pid=10789): Launched 01:52:59.698685 run osmo-stp_10.42.42.5: Starting osmo-stp 01:53:00.229182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10791): Launched 01:53:00.530534 run osmo-stp_10.42.42.5(pid=10792): Launched 01:53:00.645896 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:53:01.239637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10794): Launched 01:53:01.367230 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:53:01.649260 run patchelf(pid=10795): Launched 01:53:01.843196 run osmo-stp_10.42.42.5(pid=10792): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10792)] 01:53:01.981066 run osmo-stp_10.42.42.5(pid=10792): stdout: | (launched: 2022-12-10_01:53:00.474931) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:53:02.121240 run osmo-stp_10.42.42.5(pid=10792): stderr: | 20221210015300642 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015300643 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015300643 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015300643 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015300644 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015300644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015300644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:53:02.258505 run osmo-stp_10.42.42.5(pid=10792): stdout: | (launched: 2022-12-10_01:53:00.474931) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:53:02.390293 run osmo-stp_10.42.42.5(pid=10792): stderr: | 20221210015300642 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015300643 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015300643 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015300643 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015300644 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015300644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015300644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:53:02.545678 run patchelf(pid=10795): Terminating (SIGINT) 01:53:02.725212 run patchelf(pid=10795): Terminated: ok {rc=0} 01:53:02.854329 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10792): Process ended prematurely: osmo-stp_10.42.42.5(pid=10792) [trial-2367↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10792)] [trial-2367↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 01:53:02.864486 tst iperf3m4.py:8: Test FAILED (10.8 sec) 01:53:02.893307 run osmo-hlr_10.42.42.2(pid=10789): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10789)] 01:53:02.942761 run osmo-hlr_10.42.42.2(pid=10789): stdout: | (launched: 2022-12-10_01:52:59.527073) 01:53:02.994215 run osmo-hlr_10.42.42.2(pid=10789): stderr: | 20221210015259703 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015259703 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015259704 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015259704 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015259704 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015259704 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015259716 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015259725 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015259725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015259725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:53:03.046174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10778): Terminating (SIGTERM) 01:53:03.087592 run iperf3-srv_10.42.42.10(pid=10779): Terminating (SIGTERM) 01:53:03.128856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10780): Terminating (SIGTERM) 01:53:03.171035 run iperf3-srv_10.42.42.10(pid=10781): Terminating (SIGTERM) 01:53:03.212390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10782): Terminating (SIGTERM) 01:53:03.253892 run iperf3-srv_10.42.42.10(pid=10783): Terminating (SIGTERM) 01:53:03.295311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10784): Terminating (SIGTERM) 01:53:03.336567 run iperf3-srv_10.42.42.10(pid=10785): Terminating (SIGTERM) 01:53:03.377783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10788): Terminating (SIGTERM) 01:53:03.419254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10791): Terminating (SIGTERM) 01:53:03.460629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10794): Terminating (SIGTERM) 01:53:03.502486 --- ParallelTerminationStrategy: PID 10778 died... 01:53:03.522407 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10778): Terminated: ok {rc=0} 01:53:03.568469 --- ParallelTerminationStrategy: PID 10779 died... 01:53:03.587830 run iperf3-srv_10.42.42.10(pid=10779): Terminated {rc=256} 01:53:03.633913 --- ParallelTerminationStrategy: PID 10780 died... 01:53:03.653417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10780): Terminated: ok {rc=0} 01:53:03.699409 --- ParallelTerminationStrategy: PID 10781 died... 01:53:03.719041 run iperf3-srv_10.42.42.10(pid=10781): Terminated {rc=256} 01:53:03.764775 --- ParallelTerminationStrategy: PID 10782 died... 01:53:03.784247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10782): Terminated: ok {rc=0} 01:53:03.830109 --- ParallelTerminationStrategy: PID 10783 died... 01:53:03.849655 run iperf3-srv_10.42.42.10(pid=10783): Terminated {rc=256} 01:53:03.895436 --- ParallelTerminationStrategy: PID 10784 died... 01:53:03.914969 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10784): Terminated: ok {rc=0} 01:53:03.960725 --- ParallelTerminationStrategy: PID 10785 died... 01:53:03.980293 run iperf3-srv_10.42.42.10(pid=10785): Terminated {rc=256} 01:53:04.026117 --- ParallelTerminationStrategy: PID 10788 died... 01:53:04.045932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10788): Terminated: ok {rc=0} 01:53:04.091872 --- ParallelTerminationStrategy: PID 10791 died... 01:53:04.111512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10791): Terminated: ok {rc=0} 01:53:04.157255 --- ParallelTerminationStrategy: PID 10794 died... 01:53:04.176625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10794): Terminated: ok {rc=0} 01:53:04.264431 bus /gobi_4: Setting Powered False 01:53:05.365707 bus /gobi_4: Setting Powered False 01:53:06.481116 bus /gobi_1: Setting Powered False 01:53:07.579221 bus /gobi_1: Setting Powered False 01:53:08.693672 bus /gobi_0: Setting Powered False 01:53:09.791004 bus /gobi_0: Setting Powered False 01:53:10.909818 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 01:53:12.011699 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:12.023818 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:53:12.073159 tst ping.py: using LAC 25168 01:53:12.188680 tst ping.py: using RAC 178 01:53:12.302078 tst ping.py: using CellId 25168 01:53:12.415932 tst ping.py: using BVCI 25169 01:53:12.521659 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:12.532900 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:12.544147 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:12.555515 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:12.566984 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:12.578552 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:12.590406 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:12.601764 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:53:12.714215 tst ping.py:19: start network... 01:53:12.910663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:53:13.365688 run create_hlr_db(pid=10796): Launched 01:53:13.477676 bus /gobi_6: Setting Powered False 01:53:14.535445 run create_hlr_db(pid=10796): Terminated: ok {rc=0} 01:53:14.967885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10798): Launched 01:53:15.283041 run osmo-hlr_10.42.42.2(pid=10799): Launched 01:53:15.403515 run osmo-stp_10.42.42.5: Starting osmo-stp 01:53:15.959676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10801): Launched 01:53:16.336366 run osmo-stp_10.42.42.5(pid=10824): Launched 01:53:16.624474 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:53:17.329649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10859): Launched 01:53:17.520818 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:53:17.848665 run patchelf(pid=10883): Launched 01:53:18.109142 run osmo-stp_10.42.42.5(pid=10824): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10824)] 01:53:18.280721 run osmo-stp_10.42.42.5(pid=10824): stdout: | (launched: 2022-12-10_01:53:16.268230) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:53:18.464189 run osmo-stp_10.42.42.5(pid=10824): stderr: | 20221210015316504 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015316504 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015316504 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015316514 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015316514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015316514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015316514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:53:18.635886 run osmo-stp_10.42.42.5(pid=10824): stdout: | (launched: 2022-12-10_01:53:16.268230) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:53:18.787938 run osmo-stp_10.42.42.5(pid=10824): stderr: | 20221210015316504 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015316504 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015316504 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015316514 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015316514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015316514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015316514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:53:18.962461 run patchelf(pid=10883): Terminating (SIGINT) 01:53:19.168324 run patchelf(pid=10883): Terminated: ok {rc=0} 01:53:19.327339 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10824): Process ended prematurely: osmo-stp_10.42.42.5(pid=10824) [trial-2367↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10824)] [trial-2367↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 01:53:19.340665 tst ping.py:22: Test FAILED (7.3 sec) 01:53:19.377139 run osmo-hlr_10.42.42.2(pid=10799): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10799)] 01:53:19.436562 run osmo-hlr_10.42.42.2(pid=10799): stdout: | (launched: 2022-12-10_01:53:15.225367) 01:53:19.499972 run osmo-hlr_10.42.42.2(pid=10799): stderr: | 20221210015315422 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015315422 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015315422 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015315422 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015315422 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015315422 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015315435 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015315445 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015315445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015315445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:53:19.553490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10798): Terminating (SIGTERM) 01:53:19.604087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10801): Terminating (SIGTERM) 01:53:19.656538 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10859): Terminating (SIGTERM) 01:53:19.710881 --- ParallelTerminationStrategy: PID 10798 died... 01:53:19.737173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10798): Terminated: ok {rc=0} 01:53:19.786579 --- ParallelTerminationStrategy: PID 10801 died... 01:53:19.810207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10801): Terminated: ok {rc=0} 01:53:19.871054 --- ParallelTerminationStrategy: PID 10859 died... 01:53:19.891723 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10859): Terminated: ok {rc=0} 01:53:19.990715 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2367 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 01:53:21.107412 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:21.120432 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:53:21.173417 tst ping_idle_ping.py: using LAC 25169 01:53:21.294085 tst ping_idle_ping.py: using RAC 179 01:53:21.414749 tst ping_idle_ping.py: using CellId 25169 01:53:21.536805 tst ping_idle_ping.py: using BVCI 25170 01:53:21.649061 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:21.661339 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:21.673807 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:21.687594 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:21.699979 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:21.715526 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:21.728609 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:21.741837 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:53:21.861100 tst ping_idle_ping.py:24: start network... 01:53:22.068678 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:53:22.546984 run create_hlr_db(pid=11111): Launched 01:53:22.704306 bus /gobi_6: Setting Powered False 01:53:23.765401 run create_hlr_db(pid=11111): Terminated: ok {rc=0} 01:53:24.194359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11113): Launched 01:53:24.514357 run osmo-hlr_10.42.42.2(pid=11114): Launched 01:53:24.752676 run osmo-stp_10.42.42.5: Starting osmo-stp 01:53:25.427729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11116): Launched 01:53:25.754339 run osmo-stp_10.42.42.5(pid=11117): Launched 01:53:25.990303 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:53:26.685609 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11119): Launched 01:53:26.816213 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:53:27.079654 run patchelf(pid=11120): Launched 01:53:27.267028 run osmo-stp_10.42.42.5(pid=11117): ERR: Terminated: ERROR {rc=1} [trial-2367↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11117)] 01:53:27.398770 run osmo-stp_10.42.42.5(pid=11117): stdout: | (launched: 2022-12-10_01:53:25.693344) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:53:27.532308 run osmo-stp_10.42.42.5(pid=11117): stderr: | 20221210015326029 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015326029 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015326029 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015326030 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015326030 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015326030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015326030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:53:27.666102 run osmo-stp_10.42.42.5(pid=11117): stdout: | (launched: 2022-12-10_01:53:25.693344) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:53:27.793760 run osmo-stp_10.42.42.5(pid=11117): stderr: | 20221210015326029 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015326029 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015326029 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015326030 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015326030 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015326030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015326030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:53:27.945624 run patchelf(pid=11120): Terminating (SIGINT) 01:53:28.119234 run patchelf(pid=11120): Terminated: ok {rc=0} 01:53:28.244751 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11117): Process ended prematurely: osmo-stp_10.42.42.5(pid=11117) [trial-2367↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11117)] [trial-2367↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 01:53:28.255251 tst ping_idle_ping.py:27: Test FAILED (7.1 sec) 01:53:28.286084 run osmo-hlr_10.42.42.2(pid=11114): ERR: Terminated: ERROR {rc=237} [trial-2367↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11114)] 01:53:28.337272 run osmo-hlr_10.42.42.2(pid=11114): stdout: | (launched: 2022-12-10_01:53:24.458120) 01:53:28.390468 run osmo-hlr_10.42.42.2(pid=11114): stderr: | 20221210015324760 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015324760 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015324760 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015324760 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015324760 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015324761 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015324780 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015324793 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015324793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015324793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:53:28.444010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11113): Terminating (SIGTERM) 01:53:28.487344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11116): Terminating (SIGTERM) 01:53:28.532507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11119): Terminating (SIGTERM) 01:53:28.577597 --- ParallelTerminationStrategy: PID 11113 died... 01:53:28.597394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11113): Terminated: ok {rc=0} 01:53:28.647463 --- ParallelTerminationStrategy: PID 11116 died... 01:53:28.668084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11116): Terminated: ok {rc=0} 01:53:28.716583 --- ParallelTerminationStrategy: PID 11119 died... 01:53:28.736532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11119): Terminated: ok {rc=0} 01:53:28.828349 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 01:53:30.158074 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:53:30.167146 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:53:30.201570 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 01:53:30.239531 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:53:30.293797 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:53:30.328255 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 01:53:30.365096 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:53:30.963947 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2367 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 01:53:30.975412 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:53:30.988148 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:53:31.078615 tst switch_tch_pdch.py: using LAC 25170 01:53:31.215852 tst switch_tch_pdch.py: using RAC 180 01:53:31.363183 tst switch_tch_pdch.py: using CellId 25170 01:53:31.555220 tst switch_tch_pdch.py: using BVCI 25171 01:53:31.745385 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:53:31.762683 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:53:31.788113 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:53:31.812874 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:53:31.834757 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:53:31.861376 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:53:31.873337 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:53:31.890965 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:53:32.041969 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:53:32.175805 tst switch_tch_pdch.py:51: start network... 01:53:32.437389 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:53:32.950024 run create_hlr_db(pid=11124): Launched 01:53:33.115607 bus /gobi_6: Setting Powered False 01:53:34.179117 run create_hlr_db(pid=11124): Terminated: ok {rc=0} 01:53:34.634225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11126): Launched 01:53:34.970913 run osmo-hlr_10.42.42.2(pid=11127): Launched 01:53:35.216256 run osmo-stp_10.42.42.5: Starting osmo-stp 01:53:35.873060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11129): Launched 01:53:36.213267 run osmo-stp_10.42.42.5(pid=11130): Launched 01:53:36.458184 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:53:37.110060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11132): Launched 01:53:37.245446 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:53:37.521827 run patchelf(pid=11133): Launched 01:53:37.720373 run osmo-stp_10.42.42.5(pid=11130): ERR: Terminated: ERROR {rc=1} [trial-2367↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11130)] 01:53:37.859458 run osmo-stp_10.42.42.5(pid=11130): stdout: | (launched: 2022-12-10_01:53:36.154249) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:53:37.999187 run osmo-stp_10.42.42.5(pid=11130): stderr: | 20221210015336449 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015336449 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015336450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015336450 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015336450 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015336451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015336451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:53:38.140883 run osmo-stp_10.42.42.5(pid=11130): stdout: | (launched: 2022-12-10_01:53:36.154249) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:53:38.276366 run osmo-stp_10.42.42.5(pid=11130): stderr: | 20221210015336449 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015336449 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015336450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015336450 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015336450 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015336451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015336451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:53:38.436920 run patchelf(pid=11133): Terminating (SIGINT) 01:53:38.620248 run patchelf(pid=11133): Terminated: ok {rc=0} 01:53:38.754425 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=11130): Process ended prematurely: osmo-stp_10.42.42.5(pid=11130) [trial-2367↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11130)] [trial-2367↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 01:53:38.765465 tst switch_tch_pdch.py:54: Test FAILED (7.8 sec) 01:53:38.795285 run osmo-hlr_10.42.42.2(pid=11127): ERR: Terminated: ERROR {rc=237} [trial-2367↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11127)] 01:53:38.848501 run osmo-hlr_10.42.42.2(pid=11127): stdout: | (launched: 2022-12-10_01:53:34.912345) 01:53:38.902391 run osmo-hlr_10.42.42.2(pid=11127): stderr: | 20221210015335218 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015335219 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015335219 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015335219 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015335219 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015335219 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015335243 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015335256 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015335256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015335256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:53:38.956248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11126): Terminating (SIGTERM) 01:53:38.999944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11129): Terminating (SIGTERM) 01:53:39.047456 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11132): Terminating (SIGTERM) 01:53:39.093092 --- ParallelTerminationStrategy: PID 11126 died... 01:53:39.113565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11126): Terminated: ok {rc=0} 01:53:39.162123 --- ParallelTerminationStrategy: PID 11129 died... 01:53:39.182190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11129): Terminated: ok {rc=0} 01:53:39.230267 --- ParallelTerminationStrategy: PID 11132 died... 01:53:39.250563 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11132): Terminated: ok {rc=0} 01:53:39.340327 bus /gobi_0: Setting Powered False 01:53:40.445797 bus /gobi_0: Setting Powered False 01:53:41.560664 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2367 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 nitb_smpp --------------------------------------------------------------------- 01:53:42.824416 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:53:42.827215 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 01:53:42.848148 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 01:53:42.855570 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 01:53:42.897002 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 01:53:42.919165 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 01:53:42.926481 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 01:53:43.440610 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2367 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 01:53:43.446130 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 01:53:43.465183 tst esme_connect_policy_acceptall.py: using MSISDN 7485 01:53:43.606085 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:53:44.213703 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11141): Launched 01:53:44.538445 run osmo-nitb_10.42.42.2(pid=11142): Launched 01:53:44.720089 run osmo-nitb_10.42.42.2(pid=11142): ERR: Terminated: ERROR {rc=2} [trial-2367↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11142)] 01:53:44.864146 run osmo-nitb_10.42.42.2(pid=11142): stdout: | (launched: 2022-12-10_01:53:44.479269) 01:53:45.009811 run osmo-nitb_10.42.42.2(pid=11142): stderr: | (launched: 2022-12-10_01:53:44.527378) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:53:45.154924 run osmo-nitb_10.42.42.2(pid=11142): stdout: | (launched: 2022-12-10_01:53:44.479269) 01:53:45.294854 run osmo-nitb_10.42.42.2(pid=11142): stderr: | (launched: 2022-12-10_01:53:44.527378) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=11142): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11142) [trial-2367↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11142)] 01:53:45.662939 tst osmo-nitb_10.42.42.2(pid=11142): stdout: | (launched: 2022-12-10_01:53:44.479269) 01:53:45.793169 tst osmo-nitb_10.42.42.2(pid=11142): stderr: | (launched: 2022-12-10_01:53:44.527378) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:53:45.965963 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=11142): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11142) [trial-2367↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11142)] [trial-2367↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 01:53:45.974838 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.5 sec) 01:53:45.982056 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11141): Terminating (SIGTERM) 01:53:46.192506 --- ParallelTerminationStrategy: PID 11141 died... 01:53:46.212269 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11141): Terminated: ok {rc=0} ---------------------------------------------- trial-2367 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 01:53:46.278786 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 01:53:46.302940 tst esme_connect_policy_closed.py: using MSISDN 7486 01:53:46.436845 tst esme_connect_policy_closed.py: using MSISDN 7487 01:53:46.549546 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:53:47.157072 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11143): Launched 01:53:47.477397 run osmo-nitb_10.42.42.2(pid=11144): Launched 01:53:47.643337 run osmo-nitb_10.42.42.2(pid=11144): ERR: Terminated: ERROR {rc=2} [trial-2367↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11144)] 01:53:47.769514 run osmo-nitb_10.42.42.2(pid=11144): stdout: | (launched: 2022-12-10_01:53:47.421258) 01:53:47.896068 run osmo-nitb_10.42.42.2(pid=11144): stderr: | (launched: 2022-12-10_01:53:47.466581) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:53:48.022522 run osmo-nitb_10.42.42.2(pid=11144): stdout: | (launched: 2022-12-10_01:53:47.421258) 01:53:48.143611 run osmo-nitb_10.42.42.2(pid=11144): stderr: | (launched: 2022-12-10_01:53:47.466581) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:53:48.288170 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=11144): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11144) [trial-2367↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11144)] [trial-2367↪nitb_smpp↪esme_connect_policy_closed.py:24] 01:53:48.296514 tst esme_connect_policy_closed.py:24: Test FAILED (2.0 sec) 01:53:48.303079 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11143): Terminating (SIGTERM) 01:53:48.512434 --- ParallelTerminationStrategy: PID 11143 died... 01:53:48.533463 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11143): Terminated: ok {rc=0} ---------------------------------------------- trial-2367 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 01:53:48.581960 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 01:53:48.593233 tst nitb_smpp: Using 1 x bts (candidates: 1) 01:53:48.629566 tst esme_ms_sms_storeforward.py: using LAC 25171 01:53:48.762731 tst esme_ms_sms_storeforward.py: using RAC 181 01:53:48.889979 tst esme_ms_sms_storeforward.py: using CellId 25171 01:53:49.018101 tst esme_ms_sms_storeforward.py: using BVCI 25172 01:53:49.138448 tst nitb_smpp: Using 1 x modem (candidates: 1) 01:53:49.262720 tst esme_ms_sms_storeforward.py: using MSISDN 7488 01:53:49.374748 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 01:53:49.579429 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:53:50.202265 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11145): Launched 01:53:50.510210 run osmo-nitb_10.42.42.2(pid=11146): Launched 01:53:50.677901 run osmo-nitb_10.42.42.2(pid=11146): ERR: Terminated: ERROR {rc=2} [trial-2367↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11146)] 01:53:50.804234 run osmo-nitb_10.42.42.2(pid=11146): stdout: | (launched: 2022-12-10_01:53:50.453911) 01:53:50.931488 run osmo-nitb_10.42.42.2(pid=11146): stderr: | (launched: 2022-12-10_01:53:50.499295) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:53:51.058823 run osmo-nitb_10.42.42.2(pid=11146): stdout: | (launched: 2022-12-10_01:53:50.453911) 01:53:51.180155 run osmo-nitb_10.42.42.2(pid=11146): stderr: | (launched: 2022-12-10_01:53:50.499295) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:53:51.325437 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=11146): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11146) [trial-2367↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11146)] [trial-2367↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 01:53:51.333669 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.7 sec) 01:53:51.340166 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11145): Terminating (SIGTERM) 01:53:51.549153 --- ParallelTerminationStrategy: PID 11145 died... 01:53:51.569268 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11145): Terminated: ok {rc=0} 01:53:51.654975 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 01:53:52.742859 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 01:53:52.754247 tst nitb_smpp: Using 1 x bts (candidates: 1) 01:53:52.789900 tst esme_ms_sms_transaction.py: using LAC 25172 01:53:52.909895 tst esme_ms_sms_transaction.py: using RAC 182 01:53:53.028521 tst esme_ms_sms_transaction.py: using CellId 25172 01:53:53.150668 tst esme_ms_sms_transaction.py: using BVCI 25173 01:53:53.262546 tst nitb_smpp: Using 1 x modem (candidates: 1) 01:53:53.392937 tst esme_ms_sms_transaction.py: using MSISDN 7489 01:53:53.512760 tst esme_ms_sms_transaction.py:18: start nitb and bts... 01:53:53.732834 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:53:54.395903 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11147): Launched 01:53:54.722050 run osmo-nitb_10.42.42.2(pid=11148): Launched 01:53:54.902273 run osmo-nitb_10.42.42.2(pid=11148): ERR: Terminated: ERROR {rc=2} [trial-2367↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11148)] 01:53:55.047110 run osmo-nitb_10.42.42.2(pid=11148): stdout: | (launched: 2022-12-10_01:53:54.661920) 01:53:55.193170 run osmo-nitb_10.42.42.2(pid=11148): stderr: | (launched: 2022-12-10_01:53:54.710377) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:53:55.338930 run osmo-nitb_10.42.42.2(pid=11148): stdout: | (launched: 2022-12-10_01:53:54.661920) 01:53:55.479601 run osmo-nitb_10.42.42.2(pid=11148): stderr: | (launched: 2022-12-10_01:53:54.710377) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=11148): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11148) [trial-2367↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11148)] 01:53:55.844649 tst osmo-nitb_10.42.42.2(pid=11148): stdout: | (launched: 2022-12-10_01:53:54.661920) 01:53:55.976021 tst osmo-nitb_10.42.42.2(pid=11148): stderr: | (launched: 2022-12-10_01:53:54.710377) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:53:56.130961 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=11148): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11148) [trial-2367↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11148)] [trial-2367↪nitb_smpp↪esme_ms_sms_transaction.py:21] 01:53:56.139899 tst esme_ms_sms_transaction.py:21: Test FAILED (3.4 sec) 01:53:56.146899 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11147): Terminating (SIGTERM) 01:53:56.357595 --- ParallelTerminationStrategy: PID 11147 died... 01:53:56.379357 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11147): Terminated: ok {rc=0} 01:53:56.467196 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 smpp --------------------------------------------------------------------- 01:53:57.635355 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:53:57.638794 tst smpp: Verifying 1 x bts (candidates: 11) 01:53:57.660689 tst smpp: Verifying 6 x ip_address (candidates: 9) 01:53:57.688052 tst smpp: Verifying 1 x modem (candidates: 12) 01:53:57.723870 tst smpp: Reserving 1 x bts (candidates: 11) 01:53:57.745194 tst smpp: Reserving 6 x ip_address (candidates: 9) 01:53:57.772212 tst smpp: Reserving 1 x modem (candidates: 12) 01:53:58.300827 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2367 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 01:53:58.306489 tst smpp: Using 1 x ip_address (candidates: 6) 01:53:58.317254 tst smpp: Using 1 x ip_address (candidates: 6) 01:53:58.328293 tst smpp: Using 1 x ip_address (candidates: 6) 01:53:58.339371 tst smpp: Using 1 x ip_address (candidates: 6) 01:53:58.358310 tst esme_connect_policy_acceptall.py: using MSISDN 7490 01:53:58.476844 run osmo-stp_10.42.42.4: Starting osmo-stp 01:53:59.033373 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11152): Launched 01:53:59.341775 run osmo-stp_10.42.42.4(pid=11153): Launched 01:53:59.461641 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:53:59.937527 run create_hlr_db(pid=11154): Launched 01:54:00.056558 bus /sierra_2: Setting Powered False 01:54:01.116755 run create_hlr_db(pid=11154): Terminated: ok {rc=0} 01:54:01.596845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11156): Launched 01:54:01.941139 run osmo-hlr_10.42.42.2(pid=11157): Launched 01:54:02.251957 run osmo-msc_10.42.42.5: Starting osmo-msc 01:54:02.906501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11159): Launched 01:54:03.235460 run osmo-msc_10.42.42.5(pid=11160): Launched 01:54:03.418075 run osmo-hlr_10.42.42.2(pid=11157): ERR: Terminated: ERROR {rc=237} [trial-2367↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11157)] 01:54:03.556717 run osmo-hlr_10.42.42.2(pid=11157): stdout: | (launched: 2022-12-10_01:54:01.878934) 01:54:03.694934 run osmo-hlr_10.42.42.2(pid=11157): stderr: | 20221210015402211 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015402211 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015402211 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015402211 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015402211 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015402212 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015402234 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015402252 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015402252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015402254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:54:03.831805 run osmo-hlr_10.42.42.2(pid=11157): stdout: | (launched: 2022-12-10_01:54:01.878934) 01:54:03.961668 run osmo-hlr_10.42.42.2(pid=11157): stderr: | 20221210015402211 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015402211 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015402211 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015402211 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015402211 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015402212 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015402234 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015402252 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015402252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015402254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:54:04.116876 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=11157): Process ended prematurely: osmo-hlr_10.42.42.2(pid=11157) [trial-2367↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11157)] [trial-2367↪smpp↪esme_connect_policy_acceptall.py:23] 01:54:04.126029 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.8 sec) 01:54:04.153597 run osmo-msc_10.42.42.5(pid=11160): ERR: Terminated: ERROR {rc=9} [trial-2367↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=11160)] 01:54:04.203865 run osmo-msc_10.42.42.5(pid=11160): stdout: | (launched: 2022-12-10_01:54:03.174818) 01:54:04.256110 run osmo-msc_10.42.42.5(pid=11160): stderr: | 20221210015403540 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221210015403540 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221210015403541 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210015403541 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221210015403541 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221210015403541 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221210015403541 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221210015403541 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221210015403541 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 01:54:04.308772 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11152): Terminating (SIGTERM) 01:54:04.350859 run osmo-stp_10.42.42.4(pid=11153): Terminating (SIGTERM) 01:54:04.392735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11156): Terminating (SIGTERM) 01:54:04.436347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11159): Terminating (SIGTERM) 01:54:04.481561 --- ParallelTerminationStrategy: PID 11152 died... 01:54:04.502026 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11152): Terminated: ok {rc=0} 01:54:04.550860 --- ParallelTerminationStrategy: PID 11153 died... 01:54:04.570830 run osmo-stp_10.42.42.4(pid=11153): Terminated: ok {rc=0} 01:54:04.617338 --- ParallelTerminationStrategy: PID 11156 died... 01:54:04.637156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11156): Terminated: ok {rc=0} 01:54:04.684007 --- ParallelTerminationStrategy: PID 11159 died... 01:54:04.703940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11159): Terminated: ok {rc=0} ---------------------------------------------- trial-2367 smpp esme_connect_policy_closed.py ---------------------------------------------- 01:54:04.755294 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:04.766894 tst smpp: Using 1 x bts (candidates: 1) 01:54:04.803328 tst esme_connect_policy_closed.py: using LAC 25173 01:54:04.935873 tst esme_connect_policy_closed.py: using RAC 183 01:54:05.064178 tst esme_connect_policy_closed.py: using CellId 25173 01:54:05.190185 tst esme_connect_policy_closed.py: using BVCI 25174 01:54:05.307916 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:05.318808 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:05.329614 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:05.348846 tst esme_connect_policy_closed.py: using MSISDN 7491 01:54:05.468810 tst esme_connect_policy_closed.py: using MSISDN 7492 01:54:05.579186 run osmo-stp_10.42.42.4: Starting osmo-stp 01:54:06.099155 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11163): Launched 01:54:06.408515 run osmo-stp_10.42.42.4(pid=11164): Launched 01:54:06.526358 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:54:06.999829 run create_hlr_db(pid=11165): Launched 01:54:08.172875 run create_hlr_db(pid=11165): Terminated: ok {rc=0} 01:54:08.495458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11167): Launched 01:54:08.803391 run osmo-hlr_10.42.42.2(pid=11168): Launched 01:54:08.921476 run osmo-msc_10.42.42.5: Starting osmo-msc 01:54:09.495067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11170): Launched 01:54:09.804545 run osmo-msc_10.42.42.5(pid=11171): Launched 01:54:09.977407 run osmo-hlr_10.42.42.2(pid=11168): ERR: Terminated: ERROR {rc=237} [trial-2367↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11168)] 01:54:10.110177 run osmo-hlr_10.42.42.2(pid=11168): stdout: | (launched: 2022-12-10_01:54:08.746380) 01:54:10.250377 run osmo-hlr_10.42.42.2(pid=11168): stderr: | 20221210015408921 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015408921 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015408921 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015408921 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015408921 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015408921 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015408933 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015408942 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015408942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015408942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:54:10.387148 run osmo-hlr_10.42.42.2(pid=11168): stdout: | (launched: 2022-12-10_01:54:08.746380) 01:54:10.517665 run osmo-hlr_10.42.42.2(pid=11168): stderr: | 20221210015408921 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015408921 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015408921 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015408921 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015408921 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015408921 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015408933 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015408942 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015408942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015408942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:54:10.674260 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=11168): Process ended prematurely: osmo-hlr_10.42.42.2(pid=11168) [trial-2367↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11168)] [trial-2367↪smpp↪esme_connect_policy_closed.py:31] 01:54:10.683345 tst esme_connect_policy_closed.py:31: Test FAILED (5.9 sec) 01:54:10.711162 run osmo-msc_10.42.42.5(pid=11171): ERR: Terminated: ERROR {rc=9} [trial-2367↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=11171)] 01:54:10.762189 run osmo-msc_10.42.42.5(pid=11171): stdout: | (launched: 2022-12-10_01:54:09.747673) 01:54:10.814753 run osmo-msc_10.42.42.5(pid=11171): stderr: | 20221210015410063 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221210015410063 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221210015410063 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210015410063 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221210015410063 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221210015410063 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221210015410063 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221210015410064 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221210015410064 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 01:54:10.867877 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11163): Terminating (SIGTERM) 01:54:10.910439 run osmo-stp_10.42.42.4(pid=11164): Terminating (SIGTERM) 01:54:10.952752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11167): Terminating (SIGTERM) 01:54:10.997020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11170): Terminating (SIGTERM) 01:54:11.042435 --- ParallelTerminationStrategy: PID 11163 died... 01:54:11.063216 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11163): Terminated: ok {rc=0} 01:54:11.111348 --- ParallelTerminationStrategy: PID 11164 died... 01:54:11.131165 run osmo-stp_10.42.42.4(pid=11164): Terminated: ok {rc=0} 01:54:11.178003 --- ParallelTerminationStrategy: PID 11167 died... 01:54:11.197910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11167): Terminated: ok {rc=0} 01:54:11.244652 --- ParallelTerminationStrategy: PID 11170 died... 01:54:11.264468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11170): Terminated: ok {rc=0} ---------------------------------------------- trial-2367 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 01:54:11.315995 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:11.327603 tst smpp: Using 1 x bts (candidates: 1) 01:54:11.364284 tst esme_ms_sms_storeforward.py: using LAC 25174 01:54:11.494400 tst esme_ms_sms_storeforward.py: using RAC 184 01:54:11.622870 tst esme_ms_sms_storeforward.py: using CellId 25174 01:54:11.751910 tst esme_ms_sms_storeforward.py: using BVCI 25175 01:54:11.872256 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:11.883155 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:11.894453 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:11.905631 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:11.916638 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:11.927794 tst smpp: Using 1 x modem (candidates: 1) 01:54:12.055415 tst esme_ms_sms_storeforward.py: using MSISDN 7493 01:54:12.168520 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:54:12.644689 run create_hlr_db(pid=11174): Launched 01:54:13.817589 run create_hlr_db(pid=11174): Terminated: ok {rc=0} 01:54:14.141744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11176): Launched 01:54:14.451206 run osmo-hlr_10.42.42.2(pid=11177): Launched 01:54:14.568927 run osmo-stp_10.42.42.5: Starting osmo-stp 01:54:15.099794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11179): Launched 01:54:15.410333 run osmo-stp_10.42.42.5(pid=11180): Launched 01:54:15.529165 run osmo-msc_10.42.42.6: Starting osmo-msc 01:54:16.108103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11182): Launched 01:54:16.437784 run osmo-msc_10.42.42.6(pid=11183): Launched 01:54:16.750401 run osmo-stp_10.42.42.5(pid=11180): ERR: Terminated: ERROR {rc=1} [trial-2367↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11180)] 01:54:16.932644 run osmo-stp_10.42.42.5(pid=11180): stdout: | (launched: 2022-12-10_01:54:15.353213) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:54:17.092082 run osmo-stp_10.42.42.5(pid=11180): stderr: | 20221210015415524 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015415524 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015415524 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015415525 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015415527 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015415527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015415527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:54:17.274155 run osmo-stp_10.42.42.5(pid=11180): stdout: | (launched: 2022-12-10_01:54:15.353213) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:54:17.435668 run osmo-stp_10.42.42.5(pid=11180): stderr: | 20221210015415524 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015415524 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015415524 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015415525 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015415527 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015415527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015415527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:54:17.595478 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=11180): Process ended prematurely: osmo-stp_10.42.42.5(pid=11180) [trial-2367↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11180)] [trial-2367↪smpp↪esme_ms_sms_storeforward.py:30] 01:54:17.604436 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.3 sec) 01:54:17.632202 run osmo-hlr_10.42.42.2(pid=11177): ERR: Terminated: ERROR {rc=237} [trial-2367↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11177)] 01:54:17.683420 run osmo-hlr_10.42.42.2(pid=11177): stdout: | (launched: 2022-12-10_01:54:14.394302) 01:54:17.735860 run osmo-hlr_10.42.42.2(pid=11177): stderr: | 20221210015414571 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015414571 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015414571 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015414571 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015414571 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015414571 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015414583 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015414592 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015414592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015414592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:54:17.808998 run osmo-msc_10.42.42.6(pid=11183): ERR: Terminated: ERROR {rc=2} [trial-2367↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11183)] 01:54:17.859402 run osmo-msc_10.42.42.6(pid=11183): stdout: | (launched: 2022-12-10_01:54:16.374034) 01:54:17.911446 run osmo-msc_10.42.42.6(pid=11183): stderr: | 20221210015416958 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210015416958 DLGLOBAL DEBUG validating counter group 0x7f91a0af3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210015416958 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210015416958 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210015416958 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210015416958 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210015416960 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210015416965 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210015416970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210015416970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:54:17.964071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11176): Terminating (SIGTERM) 01:54:18.006373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11179): Terminating (SIGTERM) 01:54:18.048934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11182): Terminating (SIGTERM) 01:54:18.091433 --- ParallelTerminationStrategy: PID 11176 died... 01:54:18.111864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11176): Terminated: ok {rc=0} 01:54:18.158905 --- ParallelTerminationStrategy: PID 11179 died... 01:54:18.178631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11179): Terminated: ok {rc=0} 01:54:18.225161 --- ParallelTerminationStrategy: PID 11182 died... 01:54:18.244845 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11182): Terminated: ok {rc=0} 01:54:18.333443 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 smpp esme_ms_sms_transaction.py ---------------------------------------------- 01:54:19.421437 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:19.432813 tst smpp: Using 1 x bts (candidates: 1) 01:54:19.469792 tst esme_ms_sms_transaction.py: using LAC 25175 01:54:19.600177 tst esme_ms_sms_transaction.py: using RAC 185 01:54:19.728704 tst esme_ms_sms_transaction.py: using CellId 25175 01:54:19.855394 tst esme_ms_sms_transaction.py: using BVCI 25176 01:54:19.968324 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:19.979121 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:19.989659 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:20.000270 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:20.011039 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:20.021657 tst smpp: Using 1 x modem (candidates: 1) 01:54:20.152400 tst esme_ms_sms_transaction.py: using MSISDN 7494 01:54:20.266506 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:54:20.742619 run create_hlr_db(pid=11185): Launched 01:54:20.860264 bus /sierra_2: Setting Powered False 01:54:21.921830 run create_hlr_db(pid=11185): Terminated: ok {rc=0} 01:54:22.369096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11187): Launched 01:54:22.701221 run osmo-hlr_10.42.42.2(pid=11188): Launched 01:54:22.826613 run osmo-stp_10.42.42.5: Starting osmo-stp 01:54:23.390231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11190): Launched 01:54:23.718884 run osmo-stp_10.42.42.5(pid=11191): Launched 01:54:23.843995 run osmo-msc_10.42.42.6: Starting osmo-msc 01:54:24.435802 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11193): Launched 01:54:24.744632 run osmo-msc_10.42.42.6(pid=11194): Launched 01:54:24.916423 run osmo-stp_10.42.42.5(pid=11191): ERR: Terminated: ERROR {rc=1} [trial-2367↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11191)] 01:54:25.046886 run osmo-stp_10.42.42.5(pid=11191): stdout: | (launched: 2022-12-10_01:54:23.658044) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:54:25.176718 run osmo-stp_10.42.42.5(pid=11191): stderr: | 20221210015423851 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015423851 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015423851 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015423852 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015423852 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015423852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015423852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:54:25.305350 run osmo-stp_10.42.42.5(pid=11191): stdout: | (launched: 2022-12-10_01:54:23.658044) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:54:25.427234 run osmo-stp_10.42.42.5(pid=11191): stderr: | 20221210015423851 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015423851 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015423851 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015423852 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015423852 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015423852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015423852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:54:25.573087 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=11191): Process ended prematurely: osmo-stp_10.42.42.5(pid=11191) [trial-2367↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11191)] [trial-2367↪smpp↪esme_ms_sms_transaction.py:28] 01:54:25.581673 tst esme_ms_sms_transaction.py:28: Test FAILED (6.2 sec) 01:54:25.608332 run osmo-hlr_10.42.42.2(pid=11188): ERR: Terminated: ERROR {rc=237} [trial-2367↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11188)] 01:54:25.656190 run osmo-hlr_10.42.42.2(pid=11188): stdout: | (launched: 2022-12-10_01:54:22.639860) 01:54:25.706178 run osmo-hlr_10.42.42.2(pid=11188): stderr: | 20221210015422843 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015422843 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015422843 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015422843 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015422844 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015422844 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015422855 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015422864 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015422864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015422864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:54:25.775204 run osmo-msc_10.42.42.6(pid=11194): ERR: Terminated: ERROR {rc=2} [trial-2367↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11194)] 01:54:25.823091 run osmo-msc_10.42.42.6(pid=11194): stdout: | (launched: 2022-12-10_01:54:24.687761) 01:54:25.872713 run osmo-msc_10.42.42.6(pid=11194): stderr: | 20221210015424962 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210015424962 DLGLOBAL DEBUG validating counter group 0x7fcb88636c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210015424962 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210015424962 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210015424962 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210015424963 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210015424965 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210015424965 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210015424965 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210015424965 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:54:25.922384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11187): Terminating (SIGTERM) 01:54:25.962340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11190): Terminating (SIGTERM) 01:54:26.003211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11193): Terminating (SIGTERM) 01:54:26.043092 --- ParallelTerminationStrategy: PID 11187 died... 01:54:26.062107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11187): Terminated: ok {rc=0} 01:54:26.106818 --- ParallelTerminationStrategy: PID 11190 died... 01:54:26.125220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11190): Terminated: ok {rc=0} 01:54:26.169256 --- ParallelTerminationStrategy: PID 11193 died... 01:54:26.187741 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11193): Terminated: ok {rc=0} 01:54:26.274892 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 encryption --------------------------------------------------------------------- 01:54:27.471965 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:54:27.475852 tst encryption: Verifying 1 x bts (candidates: 11) 01:54:27.497952 tst encryption: Verifying 6 x ip_address (candidates: 9) 01:54:27.525551 tst encryption: Verifying 1 x modem (candidates: 12) 01:54:27.560482 tst encryption: Reserving 1 x bts (candidates: 11) 01:54:27.582605 tst encryption: Reserving 6 x ip_address (candidates: 9) 01:54:27.610695 tst encryption: Reserving 1 x modem (candidates: 12) 01:54:28.139970 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2367 encryption register_a5_0_authopt.py ---------------------------------------------- 01:54:28.193841 tst encryption: Using 1 x ip_address (candidates: 6) 01:54:28.204375 tst encryption: Using 1 x bts (candidates: 1) 01:54:28.238136 tst register_a5_0_authopt.py: using LAC 25176 01:54:28.360843 tst register_a5_0_authopt.py: using RAC 186 01:54:28.479981 tst register_a5_0_authopt.py: using CellId 25176 01:54:28.599162 tst register_a5_0_authopt.py: using BVCI 25177 01:54:28.712897 tst encryption: Using 1 x ip_address (candidates: 6) 01:54:28.723422 tst encryption: Using 1 x ip_address (candidates: 6) 01:54:28.733901 tst encryption: Using 1 x ip_address (candidates: 6) 01:54:28.744412 tst encryption: Using 1 x ip_address (candidates: 6) 01:54:28.755193 tst encryption: Using 1 x ip_address (candidates: 6) 01:54:28.765729 tst encryption: Using 1 x modem (candidates: 1) 01:54:28.883891 tst register_a5_0_authopt.py:8: start network... 01:54:29.107944 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:54:29.621489 run create_hlr_db(pid=11199): Launched 01:54:29.757902 bus /sierra_2: Setting Powered False 01:54:30.823289 run create_hlr_db(pid=11199): Terminated: ok {rc=0} 01:54:31.316541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11201): Launched 01:54:31.649140 run osmo-hlr_10.42.42.2(pid=11202): Launched 01:54:31.855672 run osmo-stp_10.42.42.5: Starting osmo-stp 01:54:32.512319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11204): Launched 01:54:32.843204 run osmo-stp_10.42.42.5(pid=11205): Launched 01:54:32.969077 run osmo-msc_10.42.42.6: Starting osmo-msc 01:54:33.566613 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11207): Launched 01:54:33.898609 run osmo-msc_10.42.42.6(pid=11208): Launched 01:54:34.085638 run osmo-stp_10.42.42.5(pid=11205): ERR: Terminated: ERROR {rc=1} [trial-2367↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11205)] 01:54:34.224591 run osmo-stp_10.42.42.5(pid=11205): stdout: | (launched: 2022-12-10_01:54:32.781962) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:54:34.363770 run osmo-stp_10.42.42.5(pid=11205): stderr: | 20221210015432976 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015432977 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015432977 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015432977 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015432978 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015432978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015432978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:54:34.501807 run osmo-stp_10.42.42.5(pid=11205): stdout: | (launched: 2022-12-10_01:54:32.781962) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:54:34.633418 run osmo-stp_10.42.42.5(pid=11205): stderr: | 20221210015432976 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015432977 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015432977 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015432977 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015432978 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015432978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015432978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:54:34.790946 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11205): Process ended prematurely: osmo-stp_10.42.42.5(pid=11205) [trial-2367↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11205)] [trial-2367↪encryption↪register_a5_0_authopt.py:8] 01:54:34.800725 tst register_a5_0_authopt.py:8: Test FAILED (6.6 sec) 01:54:34.828360 run osmo-hlr_10.42.42.2(pid=11202): ERR: Terminated: ERROR {rc=237} [trial-2367↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11202)] 01:54:34.878538 run osmo-hlr_10.42.42.2(pid=11202): stdout: | (launched: 2022-12-10_01:54:31.589868) 01:54:34.930425 run osmo-hlr_10.42.42.2(pid=11202): stderr: | 20221210015431964 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015431964 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015431964 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015431964 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015431964 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015431964 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015431986 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015432011 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015432011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015432011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:54:35.002541 run osmo-msc_10.42.42.6(pid=11208): ERR: Terminated: ERROR {rc=2} [trial-2367↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11208)] 01:54:35.052276 run osmo-msc_10.42.42.6(pid=11208): stdout: | (launched: 2022-12-10_01:54:33.837713) 01:54:35.103931 run osmo-msc_10.42.42.6(pid=11208): stderr: | 20221210015434163 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210015434163 DLGLOBAL DEBUG validating counter group 0x7efee989ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210015434163 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210015434163 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210015434163 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210015434164 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210015434165 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210015434166 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210015434166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210015434166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:54:35.155588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11201): Terminating (SIGTERM) 01:54:35.196985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11204): Terminating (SIGTERM) 01:54:35.238499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11207): Terminating (SIGTERM) 01:54:35.280101 --- ParallelTerminationStrategy: PID 11201 died... 01:54:35.300096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11201): Terminated: ok {rc=0} 01:54:35.346533 --- ParallelTerminationStrategy: PID 11204 died... 01:54:35.366225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11204): Terminated: ok {rc=0} 01:54:35.411730 --- ParallelTerminationStrategy: PID 11207 died... 01:54:35.431220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11207): Terminated: ok {rc=0} 01:54:35.518894 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 encryption register_a5_0_authreq.py ---------------------------------------------- 01:54:36.672406 tst encryption: Using 1 x ip_address (candidates: 6) 01:54:36.684267 tst encryption: Using 1 x bts (candidates: 1) 01:54:36.721659 tst register_a5_0_authreq.py: using LAC 25177 01:54:36.853226 tst register_a5_0_authreq.py: using RAC 187 01:54:36.984756 tst register_a5_0_authreq.py: using CellId 25177 01:54:37.115052 tst register_a5_0_authreq.py: using BVCI 25178 01:54:37.229277 tst encryption: Using 1 x ip_address (candidates: 6) 01:54:37.239912 tst encryption: Using 1 x ip_address (candidates: 6) 01:54:37.250589 tst encryption: Using 1 x ip_address (candidates: 6) 01:54:37.261693 tst encryption: Using 1 x ip_address (candidates: 6) 01:54:37.272415 tst encryption: Using 1 x ip_address (candidates: 6) 01:54:37.283264 tst encryption: Using 1 x modem (candidates: 1) 01:54:37.404710 tst register_a5_0_authreq.py:8: start network... 01:54:37.628940 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:54:38.141699 run create_hlr_db(pid=11210): Launched 01:54:38.277555 bus /sierra_2: Setting Powered False 01:54:39.342584 run create_hlr_db(pid=11210): Terminated: ok {rc=0} 01:54:39.783297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11212): Launched 01:54:40.094047 run osmo-hlr_10.42.42.2(pid=11213): Launched 01:54:40.213325 run osmo-stp_10.42.42.5: Starting osmo-stp 01:54:40.747053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11215): Launched 01:54:41.058123 run osmo-stp_10.42.42.5(pid=11216): Launched 01:54:41.179776 run osmo-msc_10.42.42.6: Starting osmo-msc 01:54:41.739709 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11218): Launched 01:54:42.051281 run osmo-msc_10.42.42.6(pid=11219): Launched 01:54:42.227923 run osmo-stp_10.42.42.5(pid=11216): ERR: Terminated: ERROR {rc=1} [trial-2367↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11216)] 01:54:42.359186 run osmo-stp_10.42.42.5(pid=11216): stdout: | (launched: 2022-12-10_01:54:41.000617) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:54:42.490139 run osmo-stp_10.42.42.5(pid=11216): stderr: | 20221210015441172 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015441173 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015441173 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015441173 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015441176 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015441176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015441176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:54:42.618641 run osmo-stp_10.42.42.5(pid=11216): stdout: | (launched: 2022-12-10_01:54:41.000617) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:54:42.741529 run osmo-stp_10.42.42.5(pid=11216): stderr: | 20221210015441172 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015441173 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015441173 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015441173 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015441176 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015441176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015441176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:54:42.888653 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11216): Process ended prematurely: osmo-stp_10.42.42.5(pid=11216) [trial-2367↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11216)] [trial-2367↪encryption↪register_a5_0_authreq.py:8] 01:54:42.897919 tst register_a5_0_authreq.py:8: Test FAILED (6.3 sec) 01:54:42.924888 run osmo-hlr_10.42.42.2(pid=11213): ERR: Terminated: ERROR {rc=237} [trial-2367↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11213)] 01:54:42.972487 run osmo-hlr_10.42.42.2(pid=11213): stdout: | (launched: 2022-12-10_01:54:40.036597) 01:54:43.021675 run osmo-hlr_10.42.42.2(pid=11213): stderr: | 20221210015440215 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015440216 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015440216 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015440216 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015440216 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015440216 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015440263 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015440272 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015440273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015440273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:54:43.090101 run osmo-msc_10.42.42.6(pid=11219): ERR: Terminated: ERROR {rc=2} [trial-2367↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11219)] 01:54:43.137675 run osmo-msc_10.42.42.6(pid=11219): stdout: | (launched: 2022-12-10_01:54:41.993842) 01:54:43.186644 run osmo-msc_10.42.42.6(pid=11219): stderr: | 20221210015442269 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210015442269 DLGLOBAL DEBUG validating counter group 0x7fc66feb5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210015442269 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210015442269 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210015442270 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210015442270 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210015442271 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210015442272 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210015442272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210015442272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:54:43.235838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11212): Terminating (SIGTERM) 01:54:43.275464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11215): Terminating (SIGTERM) 01:54:43.315259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11218): Terminating (SIGTERM) 01:54:43.355279 --- ParallelTerminationStrategy: PID 11212 died... 01:54:43.374389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11212): Terminated: ok {rc=0} 01:54:43.418986 --- ParallelTerminationStrategy: PID 11215 died... 01:54:43.437657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11215): Terminated: ok {rc=0} 01:54:43.482248 --- ParallelTerminationStrategy: PID 11218 died... 01:54:43.500908 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11218): Terminated: ok {rc=0} 01:54:43.585387 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 encryption register_a5_1_authreq.py ---------------------------------------------- 01:54:44.736534 tst encryption: Using 1 x ip_address (candidates: 6) 01:54:44.748457 tst encryption: Using 1 x bts (candidates: 1) 01:54:44.786345 tst register_a5_1_authreq.py: using LAC 25178 01:54:44.917901 tst register_a5_1_authreq.py: using RAC 188 01:54:45.048754 tst register_a5_1_authreq.py: using CellId 25178 01:54:45.179941 tst register_a5_1_authreq.py: using BVCI 25179 01:54:45.300415 tst encryption: Using 1 x ip_address (candidates: 6) 01:54:45.311425 tst encryption: Using 1 x ip_address (candidates: 6) 01:54:45.322388 tst encryption: Using 1 x ip_address (candidates: 6) 01:54:45.333313 tst encryption: Using 1 x ip_address (candidates: 6) 01:54:45.344137 tst encryption: Using 1 x ip_address (candidates: 6) 01:54:45.354969 tst encryption: Using 1 x modem (candidates: 1) 01:54:45.474164 tst register_a5_1_authreq.py:8: start network... 01:54:45.698736 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:54:46.217999 run create_hlr_db(pid=11221): Launched 01:54:46.385135 bus /sierra_2: Setting Powered False 01:54:47.451157 run create_hlr_db(pid=11221): Terminated: ok {rc=0} 01:54:47.912144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11223): Launched 01:54:48.245720 run osmo-hlr_10.42.42.2(pid=11224): Launched 01:54:48.375171 run osmo-stp_10.42.42.5: Starting osmo-stp 01:54:48.951139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11226): Launched 01:54:49.285170 run osmo-stp_10.42.42.5(pid=11227): Launched 01:54:49.412678 run osmo-msc_10.42.42.6: Starting osmo-msc 01:54:50.012115 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11229): Launched 01:54:50.346031 run osmo-msc_10.42.42.6(pid=11230): Launched 01:54:50.531704 run osmo-stp_10.42.42.5(pid=11227): ERR: Terminated: ERROR {rc=1} [trial-2367↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11227)] 01:54:50.672005 run osmo-stp_10.42.42.5(pid=11227): stdout: | (launched: 2022-12-10_01:54:49.223821) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:54:50.811842 run osmo-stp_10.42.42.5(pid=11227): stderr: | 20221210015449420 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015449420 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015449421 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015449421 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015449422 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015449422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015449422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:54:50.950354 run osmo-stp_10.42.42.5(pid=11227): stdout: | (launched: 2022-12-10_01:54:49.223821) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:54:51.082412 run osmo-stp_10.42.42.5(pid=11227): stderr: | 20221210015449420 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015449420 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015449421 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015449421 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015449422 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015449422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015449422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:54:51.240231 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11227): Process ended prematurely: osmo-stp_10.42.42.5(pid=11227) [trial-2367↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11227)] [trial-2367↪encryption↪register_a5_1_authreq.py:8] 01:54:51.250099 tst register_a5_1_authreq.py:8: Test FAILED (6.6 sec) 01:54:51.277756 run osmo-hlr_10.42.42.2(pid=11224): ERR: Terminated: ERROR {rc=237} [trial-2367↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11224)] 01:54:51.327789 run osmo-hlr_10.42.42.2(pid=11224): stdout: | (launched: 2022-12-10_01:54:48.184675) 01:54:51.379289 run osmo-hlr_10.42.42.2(pid=11224): stderr: | 20221210015448386 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015448386 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015448386 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015448386 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015448386 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015448386 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015448399 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015448408 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015448408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015448408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:54:51.451430 run osmo-msc_10.42.42.6(pid=11230): ERR: Terminated: ERROR {rc=2} [trial-2367↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11230)] 01:54:51.501631 run osmo-msc_10.42.42.6(pid=11230): stdout: | (launched: 2022-12-10_01:54:50.284715) 01:54:51.553081 run osmo-msc_10.42.42.6(pid=11230): stderr: | 20221210015450608 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210015450609 DLGLOBAL DEBUG validating counter group 0x7f5a6d317c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210015450609 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210015450609 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210015450609 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210015450609 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210015450611 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210015450611 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210015450611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210015450611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:54:51.604608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11223): Terminating (SIGTERM) 01:54:51.646048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11226): Terminating (SIGTERM) 01:54:51.688004 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11229): Terminating (SIGTERM) 01:54:51.730001 --- ParallelTerminationStrategy: PID 11223 died... 01:54:51.750200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11223): Terminated: ok {rc=0} 01:54:51.796597 --- ParallelTerminationStrategy: PID 11226 died... 01:54:51.816330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11226): Terminated: ok {rc=0} 01:54:51.862326 --- ParallelTerminationStrategy: PID 11229 died... 01:54:51.882104 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11229): Terminated: ok {rc=0} 01:54:51.969047 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2367 encryption register_a5_3_authreq.py ---------------------------------------------- 01:54:53.119170 tst encryption: Using 1 x ip_address (candidates: 6) 01:54:53.130701 tst encryption: Using 1 x bts (candidates: 1) 01:54:53.169312 tst register_a5_3_authreq.py: using LAC 25179 01:54:53.293260 tst register_a5_3_authreq.py: using RAC 189 01:54:53.418186 tst register_a5_3_authreq.py: using CellId 25179 01:54:53.541619 tst register_a5_3_authreq.py: using BVCI 25180 01:54:53.655169 tst encryption: Using 1 x ip_address (candidates: 6) 01:54:53.666001 tst encryption: Using 1 x ip_address (candidates: 6) 01:54:53.676347 tst encryption: Using 1 x ip_address (candidates: 6) 01:54:53.687656 tst encryption: Using 1 x ip_address (candidates: 6) 01:54:53.698787 tst encryption: Using 1 x ip_address (candidates: 6) 01:54:53.709962 tst encryption: Using 1 x modem (candidates: 1) 01:54:53.837452 tst register_a5_3_authreq.py:8: start network... 01:54:54.046392 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:54:54.527525 run create_hlr_db(pid=11232): Launched 01:54:54.647362 bus /sierra_2: Setting Powered False 01:54:55.708504 run create_hlr_db(pid=11232): Terminated: ok {rc=0} 01:54:56.159876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11234): Launched 01:54:56.492036 run osmo-hlr_10.42.42.2(pid=11235): Launched 01:54:56.619596 run osmo-stp_10.42.42.5: Starting osmo-stp 01:54:57.188158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11237): Launched 01:54:57.520191 run osmo-stp_10.42.42.5(pid=11238): Launched 01:54:57.647976 run osmo-msc_10.42.42.6: Starting osmo-msc 01:54:58.246333 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11240): Launched 01:54:58.580100 run osmo-msc_10.42.42.6(pid=11241): Launched 01:54:58.766592 run osmo-stp_10.42.42.5(pid=11238): ERR: Terminated: ERROR {rc=1} [trial-2367↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11238)] 01:54:58.905917 run osmo-stp_10.42.42.5(pid=11238): stdout: | (launched: 2022-12-10_01:54:57.459473) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:54:59.046477 run osmo-stp_10.42.42.5(pid=11238): stderr: | 20221210015457656 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015457656 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015457657 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015457657 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015457657 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015457658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015457658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:54:59.184547 run osmo-stp_10.42.42.5(pid=11238): stdout: | (launched: 2022-12-10_01:54:57.459473) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:54:59.316096 run osmo-stp_10.42.42.5(pid=11238): stderr: | 20221210015457656 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015457656 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015457657 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015457657 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015457657 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015457658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015457658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:54:59.473757 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11238): Process ended prematurely: osmo-stp_10.42.42.5(pid=11238) [trial-2367↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11238)] [trial-2367↪encryption↪register_a5_3_authreq.py:8] 01:54:59.483708 tst register_a5_3_authreq.py:8: Test FAILED (6.4 sec) 01:54:59.511689 run osmo-hlr_10.42.42.2(pid=11235): ERR: Terminated: ERROR {rc=237} [trial-2367↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11235)] 01:54:59.562349 run osmo-hlr_10.42.42.2(pid=11235): stdout: | (launched: 2022-12-10_01:54:56.431351) 01:54:59.614446 run osmo-hlr_10.42.42.2(pid=11235): stderr: | 20221210015456630 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015456630 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015456630 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015456630 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015456630 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015456630 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015456646 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015456655 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015456655 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015456655 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:54:59.686840 run osmo-msc_10.42.42.6(pid=11241): ERR: Terminated: ERROR {rc=2} [trial-2367↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11241)] 01:54:59.736804 run osmo-msc_10.42.42.6(pid=11241): stdout: | (launched: 2022-12-10_01:54:58.519327) 01:54:59.788186 run osmo-msc_10.42.42.6(pid=11241): stderr: | 20221210015458846 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210015458846 DLGLOBAL DEBUG validating counter group 0x7f8439b98c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210015458847 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210015458847 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210015458847 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210015458847 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210015458849 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210015458849 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210015458849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210015458849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:54:59.840050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11234): Terminating (SIGTERM) 01:54:59.881639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11237): Terminating (SIGTERM) 01:54:59.923121 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11240): Terminating (SIGTERM) 01:54:59.964883 --- ParallelTerminationStrategy: PID 11234 died... 01:54:59.984839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11234): Terminated: ok {rc=0} 01:55:00.031170 --- ParallelTerminationStrategy: PID 11237 died... 01:55:00.050676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11237): Terminated: ok {rc=0} 01:55:00.096592 --- ParallelTerminationStrategy: PID 11240 died... 01:55:00.116047 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11240): Terminated: ok {rc=0} 01:55:00.203874 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 01:55:01.454253 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:55:01.460306 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 01:55:01.479671 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 01:55:01.508198 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 01:55:01.535373 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 01:55:01.555461 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 01:55:01.583654 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 01:55:02.090824 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2367 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 01:55:02.099566 tst handover.py:11: TEST_CONFIG: {} 01:55:02.360136 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 01:55:02.377202 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 01:55:02.401260 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 01:55:02.451287 tst handover.py: using MSISDN 7495 01:55:02.566131 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7495', subscriber_id=0} 01:55:02.674171 run srsepc_10.42.42.118: Starting srsepc 01:55:04.522473 run rm-remote-dir(pid=11249): Launched 01:55:04.646557 bus /sierra_2: Setting Powered False 01:55:05.713235 run rm-remote-dir(pid=11249): Terminated: ok {rc=0} 01:55:06.178806 run mk-remote-dir(pid=11250): Launched 01:55:07.372482 run mk-remote-dir(pid=11250): Terminated: ok {rc=0} 01:55:07.686323 run scp-inst-to-remote(pid=11251): Launched 01:55:09.879573 run scp-inst-to-remote(pid=11251): Terminated: ok {rc=0} 01:55:10.239197 run rm-remote-dir(pid=11253): Launched 01:55:11.431949 run rm-remote-dir(pid=11253): Terminated: ok {rc=0} 01:55:11.794085 run mk-remote-dir(pid=11254): Launched 01:55:12.992384 run mk-remote-dir(pid=11254): Terminated: ok {rc=0} 01:55:13.300008 run scp-cfg-to-remote(pid=11255): Launched 01:55:14.490920 run scp-cfg-to-remote(pid=11255): Terminated: ok {rc=0} 01:55:14.796858 run scp-db-to-remote(pid=11257): Launched 01:55:16.008161 run scp-db-to-remote(pid=11257): Terminated: ok {rc=0} 01:55:16.184102 run srsepc_10.42.42.118: Setting RPATH for srsepc 01:55:16.510845 run patchelf(pid=11259): Launched 01:55:17.791885 run patchelf(pid=11259): Terminated: ok {rc=0} 01:55:17.932319 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 01:55:18.265430 run setcap-netadm(pid=11260): Launched 01:55:19.457936 run setcap-netadm(pid=11260): Terminated: ok {rc=0} 01:55:19.806680 run srsepc(pid=11261): Launched 01:55:19.932782 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 01:55:21.127010 run rm-remote-dir(pid=11262): Launched 01:55:21.317609 run srsepc(pid=11261): ERR: Terminated: ERROR {rc=127} [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11261)] 01:55:21.462307 run srsepc(pid=11261): stdout: | (launched: 2022-12-10_01:55:19.745689) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:55:21.606914 run srsepc(pid=11261): stderr: | (launched: 2022-12-10_01:55:19.794923) | Connection to 10.42.42.116 closed. 01:55:21.752471 run srsepc(pid=11261): stdout: | (launched: 2022-12-10_01:55:19.745689) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:55:21.891209 run srsepc(pid=11261): stderr: | (launched: 2022-12-10_01:55:19.794923) | Connection to 10.42.42.116 closed. 01:55:22.055823 run rm-remote-dir(pid=11262): Terminating (SIGINT) 01:55:22.245386 run rm-remote-dir(pid=11262): Terminated: ok {rc=0} 01:55:22.382175 tst handover.py:37: ERR: Error: srsepc(pid=11261): Process ended prematurely: srsepc(pid=11261) [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11261)] [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 01:55:22.392923 tst handover.py:37: Test FAILED (20.3 sec) 01:55:22.474672 run scp-back-log(pid=11263): Launched 01:55:23.555968 run scp-back-log(pid=11263): ERR: Terminated: ERROR {rc=1} [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11263)] 01:55:23.620103 run scp-back-log(pid=11263): stdout: | (launched: 2022-12-10_01:55:22.442150) 01:55:23.686371 run scp-back-log(pid=11263): stderr: | (launched: 2022-12-10_01:55:22.462910) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 01:55:23.760601 tst srsepc_10.42.42.118: Error('scp-back-log(pid=11263): launch_sync(): local process exited with status 1 [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11263)]') ---------------------------------------------- trial-2367 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 01:55:23.808339 tst iperf3_bidir.py:13: Number of physical ue: 1 01:55:24.029914 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 01:55:24.073292 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 01:55:24.293553 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 01:55:24.310100 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 01:55:24.342540 tst iperf3_bidir.py: using MSISDN 7496 01:55:24.461248 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7496', subscriber_id=0} 01:55:24.575813 run srsepc_10.42.42.118: Starting srsepc 01:55:25.250475 run rm-remote-dir(pid=11265): Launched 01:55:26.443586 run rm-remote-dir(pid=11265): Terminated: ok {rc=0} 01:55:26.803741 run mk-remote-dir(pid=11266): Launched 01:55:27.998095 run mk-remote-dir(pid=11266): Terminated: ok {rc=0} 01:55:28.303845 run scp-inst-to-remote(pid=11267): Launched 01:55:30.494509 run scp-inst-to-remote(pid=11267): Terminated: ok {rc=0} 01:55:30.840625 run rm-remote-dir(pid=11269): Launched 01:55:32.118067 run rm-remote-dir(pid=11269): Terminated: ok {rc=0} 01:55:32.482526 run mk-remote-dir(pid=11270): Launched 01:55:33.676215 run mk-remote-dir(pid=11270): Terminated: ok {rc=0} 01:55:33.983582 run scp-cfg-to-remote(pid=11271): Launched 01:55:35.175659 run scp-cfg-to-remote(pid=11271): Terminated: ok {rc=0} 01:55:35.480031 run scp-db-to-remote(pid=11273): Launched 01:55:36.670935 run scp-db-to-remote(pid=11273): Terminated: ok {rc=0} 01:55:36.811403 run srsepc_10.42.42.118: Setting RPATH for srsepc 01:55:37.142537 run patchelf(pid=11275): Launched 01:55:38.333971 run patchelf(pid=11275): Terminated: ok {rc=0} 01:55:38.474252 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 01:55:38.806268 run setcap-netadm(pid=11276): Launched 01:55:39.996654 run setcap-netadm(pid=11276): Terminated: ok {rc=0} 01:55:40.344340 run srsepc(pid=11277): Launched 01:55:40.468318 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 01:55:41.661599 run rm-remote-dir(pid=11278): Launched 01:55:41.855829 run srsepc(pid=11277): ERR: Terminated: ERROR {rc=127} [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11277)] 01:55:42.001520 run srsepc(pid=11277): stdout: | (launched: 2022-12-10_01:55:40.283474) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:55:42.146714 run srsepc(pid=11277): stderr: | (launched: 2022-12-10_01:55:40.332557) | Connection to 10.42.42.116 closed. 01:55:42.291602 run srsepc(pid=11277): stdout: | (launched: 2022-12-10_01:55:40.283474) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:55:42.430837 run srsepc(pid=11277): stderr: | (launched: 2022-12-10_01:55:40.332557) | Connection to 10.42.42.116 closed. 01:55:42.595673 run rm-remote-dir(pid=11278): Terminating (SIGINT) 01:55:42.786422 run rm-remote-dir(pid=11278): Terminated: ok {rc=0} 01:55:42.924228 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=11277): Process ended prematurely: srsepc(pid=11277) [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11277)] [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 01:55:42.935131 tst iperf3_bidir.py:42: Test FAILED (19.1 sec) 01:55:43.017472 run scp-back-log(pid=11279): Launched 01:55:44.097824 run scp-back-log(pid=11279): ERR: Terminated: ERROR {rc=1} [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11279)] 01:55:44.159684 run scp-back-log(pid=11279): stdout: | (launched: 2022-12-10_01:55:42.984213) 01:55:44.222580 run scp-back-log(pid=11279): stderr: | (launched: 2022-12-10_01:55:43.005206) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 01:55:44.293122 tst srsepc_10.42.42.118: Error('scp-back-log(pid=11279): launch_sync(): local process exited with status 1 [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11279)]') ---------------------------------------------- trial-2367 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 01:55:44.338926 tst iperf3_dl.py:13: Number of physical ue: 1 01:55:44.546199 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 01:55:44.590799 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 01:55:44.797476 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 01:55:44.813269 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 01:55:44.845610 tst iperf3_dl.py: using MSISDN 7497 01:55:44.966937 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7497', subscriber_id=0} 01:55:45.082732 run srsepc_10.42.42.118: Starting srsepc 01:55:45.755894 run rm-remote-dir(pid=11281): Launched 01:55:46.963357 run rm-remote-dir(pid=11281): Terminated: ok {rc=0} 01:55:47.310939 run mk-remote-dir(pid=11282): Launched 01:55:48.492169 run mk-remote-dir(pid=11282): Terminated: ok {rc=0} 01:55:48.780036 run scp-inst-to-remote(pid=11283): Launched 01:55:50.958945 run scp-inst-to-remote(pid=11283): Terminated: ok {rc=0} 01:55:51.294636 run rm-remote-dir(pid=11285): Launched 01:55:52.474212 run rm-remote-dir(pid=11285): Terminated: ok {rc=0} 01:55:52.810796 run mk-remote-dir(pid=11286): Launched 01:55:53.991765 run mk-remote-dir(pid=11286): Terminated: ok {rc=0} 01:55:54.279537 run scp-cfg-to-remote(pid=11287): Launched 01:55:55.456901 run scp-cfg-to-remote(pid=11287): Terminated: ok {rc=0} 01:55:55.742368 run scp-db-to-remote(pid=11289): Launched 01:55:56.919093 run scp-db-to-remote(pid=11289): Terminated: ok {rc=0} 01:55:57.050652 run srsepc_10.42.42.118: Setting RPATH for srsepc 01:55:57.360203 run patchelf(pid=11291): Launched 01:55:58.537373 run patchelf(pid=11291): Terminated: ok {rc=0} 01:55:58.668878 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 01:55:58.978492 run setcap-netadm(pid=11292): Launched 01:56:00.155570 run setcap-netadm(pid=11292): Terminated: ok {rc=0} 01:56:00.480730 run srsepc(pid=11293): Launched 01:56:00.595607 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 01:56:01.737729 run rm-remote-dir(pid=11294): Launched 01:56:02.048396 run srsepc(pid=11293): ERR: Terminated: ERROR {rc=127} [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11293)] 01:56:02.201933 run srsepc(pid=11293): stdout: | (launched: 2022-12-10_01:56:00.422532) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:56:02.346969 run srsepc(pid=11293): stderr: | (launched: 2022-12-10_01:56:00.469304) | Connection to 10.42.42.116 closed. 01:56:02.491484 run srsepc(pid=11293): stdout: | (launched: 2022-12-10_01:56:00.422532) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:56:02.630911 run srsepc(pid=11293): stderr: | (launched: 2022-12-10_01:56:00.469304) | Connection to 10.42.42.116 closed. 01:56:02.795959 run rm-remote-dir(pid=11294): Terminating (SIGINT) 01:56:02.985436 run rm-remote-dir(pid=11294): Terminated: ok {rc=0} 01:56:03.122662 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=11293): Process ended prematurely: srsepc(pid=11293) [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11293)] [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 01:56:03.133469 tst iperf3_dl.py:42: Test FAILED (18.8 sec) 01:56:03.215456 run scp-back-log(pid=11295): Launched 01:56:04.296095 run scp-back-log(pid=11295): ERR: Terminated: ERROR {rc=1} [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11295)] 01:56:04.360229 run scp-back-log(pid=11295): stdout: | (launched: 2022-12-10_01:56:03.182541) 01:56:04.425585 run scp-back-log(pid=11295): stderr: | (launched: 2022-12-10_01:56:03.203279) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 01:56:04.499455 tst srsepc_10.42.42.118: Error('scp-back-log(pid=11295): launch_sync(): local process exited with status 1 [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11295)]') ---------------------------------------------- trial-2367 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 01:56:04.546768 tst iperf3_ul.py:13: Number of physical ue: 1 01:56:04.768365 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 01:56:04.811124 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 01:56:05.031818 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 01:56:05.048262 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 01:56:05.080890 tst iperf3_ul.py: using MSISDN 7498 01:56:05.200667 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7498', subscriber_id=0} 01:56:05.316162 run srsepc_10.42.42.118: Starting srsepc 01:56:05.992112 run rm-remote-dir(pid=11297): Launched 01:56:07.187608 run rm-remote-dir(pid=11297): Terminated: ok {rc=0} 01:56:07.549648 run mk-remote-dir(pid=11298): Launched 01:56:08.744210 run mk-remote-dir(pid=11298): Terminated: ok {rc=0} 01:56:09.051726 run scp-inst-to-remote(pid=11299): Launched 01:56:11.245883 run scp-inst-to-remote(pid=11299): Terminated: ok {rc=0} 01:56:11.604914 run rm-remote-dir(pid=11301): Launched 01:56:12.798794 run rm-remote-dir(pid=11301): Terminated: ok {rc=0} 01:56:13.159529 run mk-remote-dir(pid=11302): Launched 01:56:14.349918 run mk-remote-dir(pid=11302): Terminated: ok {rc=0} 01:56:14.639082 run scp-cfg-to-remote(pid=11303): Launched 01:56:15.817542 run scp-cfg-to-remote(pid=11303): Terminated: ok {rc=0} 01:56:16.154631 run scp-db-to-remote(pid=11305): Launched 01:56:17.399640 run scp-db-to-remote(pid=11305): Terminated: ok {rc=0} 01:56:17.532445 run srsepc_10.42.42.118: Setting RPATH for srsepc 01:56:17.846275 run patchelf(pid=11307): Launched 01:56:19.023908 run patchelf(pid=11307): Terminated: ok {rc=0} 01:56:19.156767 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 01:56:19.469551 run setcap-netadm(pid=11308): Launched 01:56:20.648690 run setcap-netadm(pid=11308): Terminated: ok {rc=0} 01:56:20.977159 run srsepc(pid=11309): Launched 01:56:21.093247 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 01:56:22.213269 run rm-remote-dir(pid=11310): Launched 01:56:22.390773 run srsepc(pid=11309): ERR: Terminated: ERROR {rc=127} [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11309)] 01:56:22.525824 run srsepc(pid=11309): stdout: | (launched: 2022-12-10_01:56:20.919510) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:56:22.662090 run srsepc(pid=11309): stderr: | (launched: 2022-12-10_01:56:20.965712) | Connection to 10.42.42.116 closed. 01:56:22.798414 run srsepc(pid=11309): stdout: | (launched: 2022-12-10_01:56:20.919510) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:56:22.928792 run srsepc(pid=11309): stderr: | (launched: 2022-12-10_01:56:20.965712) | Connection to 10.42.42.116 closed. 01:56:23.082919 run rm-remote-dir(pid=11310): Terminating (SIGINT) 01:56:23.260611 run rm-remote-dir(pid=11310): Terminated: ok {rc=0} 01:56:23.389692 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=11309): Process ended prematurely: srsepc(pid=11309) [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11309)] [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 01:56:23.400003 tst iperf3_ul.py:42: Test FAILED (18.8 sec) 01:56:23.478489 run scp-back-log(pid=11311): Launched 01:56:24.558567 run scp-back-log(pid=11311): ERR: Terminated: ERROR {rc=1} [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11311)] 01:56:24.620244 run scp-back-log(pid=11311): stdout: | (launched: 2022-12-10_01:56:23.447249) 01:56:24.683525 run scp-back-log(pid=11311): stderr: | (launched: 2022-12-10_01:56:23.466885) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 01:56:24.754662 tst srsepc_10.42.42.118: Error('scp-back-log(pid=11311): launch_sync(): local process exited with status 1 [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11311)]') ---------------------------------------------- trial-2367 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 01:56:24.801035 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 01:56:24.818073 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 01:56:24.841328 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 01:56:24.889543 tst ping.py: using MSISDN 7499 01:56:25.004117 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7499', subscriber_id=0} 01:56:25.112088 run srsepc_10.42.42.118: Starting srsepc 01:56:25.744187 run rm-remote-dir(pid=11313): Launched 01:56:26.923738 run rm-remote-dir(pid=11313): Terminated: ok {rc=0} 01:56:27.262184 run mk-remote-dir(pid=11314): Launched 01:56:28.441225 run mk-remote-dir(pid=11314): Terminated: ok {rc=0} 01:56:28.728800 run scp-inst-to-remote(pid=11315): Launched 01:56:30.916239 run scp-inst-to-remote(pid=11315): Terminated: ok {rc=0} 01:56:31.315813 run rm-remote-dir(pid=11317): Launched 01:56:32.554549 run rm-remote-dir(pid=11317): Terminated: ok {rc=0} 01:56:32.892436 run mk-remote-dir(pid=11318): Launched 01:56:34.074503 run mk-remote-dir(pid=11318): Terminated: ok {rc=0} 01:56:34.381691 run scp-cfg-to-remote(pid=11319): Launched 01:56:35.572627 run scp-cfg-to-remote(pid=11319): Terminated: ok {rc=0} 01:56:35.877953 run scp-db-to-remote(pid=11321): Launched 01:56:37.068644 run scp-db-to-remote(pid=11321): Terminated: ok {rc=0} 01:56:37.208545 run srsepc_10.42.42.118: Setting RPATH for srsepc 01:56:37.540397 run patchelf(pid=11323): Launched 01:56:38.731388 run patchelf(pid=11323): Terminated: ok {rc=0} 01:56:38.871908 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 01:56:39.202603 run setcap-netadm(pid=11324): Launched 01:56:40.393237 run setcap-netadm(pid=11324): Terminated: ok {rc=0} 01:56:40.740112 run srsepc(pid=11325): Launched 01:56:40.865948 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 01:56:41.997547 run rm-remote-dir(pid=11326): Launched 01:56:42.176164 run srsepc(pid=11325): ERR: Terminated: ERROR {rc=127} [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11325)] 01:56:42.312027 run srsepc(pid=11325): stdout: | (launched: 2022-12-10_01:56:40.678679) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:56:42.450219 run srsepc(pid=11325): stderr: | (launched: 2022-12-10_01:56:40.727920) | Connection to 10.42.42.116 closed. 01:56:42.587238 run srsepc(pid=11325): stdout: | (launched: 2022-12-10_01:56:40.678679) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:56:42.718754 run srsepc(pid=11325): stderr: | (launched: 2022-12-10_01:56:40.727920) | Connection to 10.42.42.116 closed. 01:56:42.874024 run rm-remote-dir(pid=11326): Terminating (SIGINT) 01:56:43.054031 run rm-remote-dir(pid=11326): Terminated: ok {rc=0} 01:56:43.195334 tst ping.py:16: ERR: Error: srsepc(pid=11325): Process ended prematurely: srsepc(pid=11325) [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11325)] [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 01:56:43.206473 tst ping.py:16: Test FAILED (18.4 sec) 01:56:43.288086 run scp-back-log(pid=11327): Launched 01:56:44.368921 run scp-back-log(pid=11327): ERR: Terminated: ERROR {rc=1} [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11327)] 01:56:44.432791 run scp-back-log(pid=11327): stdout: | (launched: 2022-12-10_01:56:43.255819) 01:56:44.498106 run scp-back-log(pid=11327): stderr: | (launched: 2022-12-10_01:56:43.276482) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 01:56:44.571608 tst srsepc_10.42.42.118: Error('scp-back-log(pid=11327): launch_sync(): local process exited with status 1 [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11327)]') ---------------------------------------------- trial-2367 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 01:56:44.619387 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 01:56:44.636916 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 01:56:44.660588 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 01:56:44.711230 tst rrc_idle_mo_ping.py: using MSISDN 7500 01:56:44.833450 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7500', subscriber_id=0} 01:56:44.948039 run srsepc_10.42.42.118: Starting srsepc 01:56:45.620825 run rm-remote-dir(pid=11330): Launched 01:56:46.808197 run rm-remote-dir(pid=11330): Terminated: ok {rc=0} 01:56:47.152567 run mk-remote-dir(pid=11331): Launched 01:56:48.370465 run mk-remote-dir(pid=11331): Terminated: ok {rc=0} 01:56:48.658578 run scp-inst-to-remote(pid=11332): Launched 01:56:50.837230 run scp-inst-to-remote(pid=11332): Terminated: ok {rc=0} 01:56:51.173437 run rm-remote-dir(pid=11334): Launched 01:56:52.353639 run rm-remote-dir(pid=11334): Terminated: ok {rc=0} 01:56:52.690767 run mk-remote-dir(pid=11335): Launched 01:56:53.870339 run mk-remote-dir(pid=11335): Terminated: ok {rc=0} 01:56:54.158759 run scp-cfg-to-remote(pid=11336): Launched 01:56:55.335542 run scp-cfg-to-remote(pid=11336): Terminated: ok {rc=0} 01:56:55.620799 run scp-db-to-remote(pid=11338): Launched 01:56:56.799065 run scp-db-to-remote(pid=11338): Terminated: ok {rc=0} 01:56:56.931003 run srsepc_10.42.42.118: Setting RPATH for srsepc 01:56:57.241606 run patchelf(pid=11340): Launched 01:56:58.419828 run patchelf(pid=11340): Terminated: ok {rc=0} 01:56:58.551808 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 01:56:58.862251 run setcap-netadm(pid=11341): Launched 01:57:00.038662 run setcap-netadm(pid=11341): Terminated: ok {rc=0} 01:57:00.364366 run srsepc(pid=11342): Launched 01:57:00.479274 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 01:57:01.633745 run rm-remote-dir(pid=11343): Launched 01:57:01.925801 run srsepc(pid=11342): ERR: Terminated: ERROR {rc=127} [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11342)] 01:57:02.070475 run srsepc(pid=11342): stdout: | (launched: 2022-12-10_01:57:00.307018) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:57:02.210421 run srsepc(pid=11342): stderr: | (launched: 2022-12-10_01:57:00.352767) | Connection to 10.42.42.116 closed. 01:57:02.348598 run srsepc(pid=11342): stdout: | (launched: 2022-12-10_01:57:00.307018) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:57:02.478814 run srsepc(pid=11342): stderr: | (launched: 2022-12-10_01:57:00.352767) | Connection to 10.42.42.116 closed. 01:57:02.634070 run rm-remote-dir(pid=11343): Terminating (SIGINT) 01:57:02.812813 run rm-remote-dir(pid=11343): Terminated: ok {rc=0} 01:57:02.942062 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=11342): Process ended prematurely: srsepc(pid=11342) [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11342)] [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 01:57:02.952045 tst rrc_idle_mo_ping.py:16: Test FAILED (18.3 sec) 01:57:03.031772 run scp-back-log(pid=11344): Launched 01:57:04.108934 run scp-back-log(pid=11344): ERR: Terminated: ERROR {rc=1} [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11344)] 01:57:04.169859 run scp-back-log(pid=11344): stdout: | (launched: 2022-12-10_01:57:02.999580) 01:57:04.232439 run scp-back-log(pid=11344): stderr: | (launched: 2022-12-10_01:57:03.019586) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 01:57:04.308932 tst srsepc_10.42.42.118: Error('scp-back-log(pid=11344): launch_sync(): local process exited with status 1 [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11344)]') ---------------------------------------------- trial-2367 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 01:57:04.357801 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 01:57:04.375406 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 01:57:04.399814 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 01:57:04.449465 tst rrc_idle_mt_ping.py: using MSISDN 7501 01:57:04.574111 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7501', subscriber_id=0} 01:57:04.689773 run srsepc_10.42.42.118: Starting srsepc 01:57:05.366297 run rm-remote-dir(pid=11346): Launched 01:57:06.555685 run rm-remote-dir(pid=11346): Terminated: ok {rc=0} 01:57:06.894623 run mk-remote-dir(pid=11347): Launched 01:57:08.074888 run mk-remote-dir(pid=11347): Terminated: ok {rc=0} 01:57:08.363055 run scp-inst-to-remote(pid=11348): Launched 01:57:10.542733 run scp-inst-to-remote(pid=11348): Terminated: ok {rc=0} 01:57:10.879548 run rm-remote-dir(pid=11350): Launched 01:57:12.059530 run rm-remote-dir(pid=11350): Terminated: ok {rc=0} 01:57:12.397604 run mk-remote-dir(pid=11351): Launched 01:57:13.578028 run mk-remote-dir(pid=11351): Terminated: ok {rc=0} 01:57:13.866055 run scp-cfg-to-remote(pid=11352): Launched 01:57:15.043297 run scp-cfg-to-remote(pid=11352): Terminated: ok {rc=0} 01:57:15.328845 run scp-db-to-remote(pid=11354): Launched 01:57:16.523946 run scp-db-to-remote(pid=11354): Terminated: ok {rc=0} 01:57:16.701103 run srsepc_10.42.42.118: Setting RPATH for srsepc 01:57:17.063113 run patchelf(pid=11356): Launched 01:57:18.298313 run patchelf(pid=11356): Terminated: ok {rc=0} 01:57:18.430524 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 01:57:18.742930 run setcap-netadm(pid=11357): Launched 01:57:19.920113 run setcap-netadm(pid=11357): Terminated: ok {rc=0} 01:57:20.246879 run srsepc(pid=11358): Launched 01:57:20.363726 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 01:57:21.485529 run rm-remote-dir(pid=11359): Launched 01:57:21.662972 run srsepc(pid=11358): ERR: Terminated: ERROR {rc=127} [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11358)] 01:57:21.798257 run srsepc(pid=11358): stdout: | (launched: 2022-12-10_01:57:20.189096) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:57:21.934558 run srsepc(pid=11358): stderr: | (launched: 2022-12-10_01:57:20.235034) | Connection to 10.42.42.116 closed. 01:57:22.070844 run srsepc(pid=11358): stdout: | (launched: 2022-12-10_01:57:20.189096) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:57:22.200924 run srsepc(pid=11358): stderr: | (launched: 2022-12-10_01:57:20.235034) | Connection to 10.42.42.116 closed. 01:57:22.355961 run rm-remote-dir(pid=11359): Terminating (SIGINT) 01:57:22.535077 run rm-remote-dir(pid=11359): Terminated: ok {rc=0} 01:57:22.664511 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=11358): Process ended prematurely: srsepc(pid=11358) [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11358)] [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 01:57:22.675017 tst rrc_idle_mt_ping.py:16: Test FAILED (18.3 sec) 01:57:22.754096 run scp-back-log(pid=11360): Launched 01:57:23.829725 run scp-back-log(pid=11360): ERR: Terminated: ERROR {rc=1} [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11360)] 01:57:23.890306 run scp-back-log(pid=11360): stdout: | (launched: 2022-12-10_01:57:22.722120) 01:57:23.952558 run scp-back-log(pid=11360): stderr: | (launched: 2022-12-10_01:57:22.741720) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 01:57:24.022372 tst srsepc_10.42.42.118: Error('scp-back-log(pid=11360): launch_sync(): local process exited with status 1 [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11360)]') --------------------------------------------------------------------- trial-2367 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 01:57:24.153111 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:57:24.158263 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 01:57:24.199504 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 01:57:24.225948 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 01:57:24.278647 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 01:57:24.322046 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 01:57:24.348482 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 01:57:24.896375 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 01:57:24.901955 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 01:57:24.912668 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 01:57:24.950545 tst handover.py: using LAC 25180 01:57:25.074411 tst handover.py: using RAC 190 01:57:25.194806 tst handover.py: using CellId 25180 01:57:25.316438 tst handover.py: using BVCI 25181 01:57:25.428027 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 01:57:25.462531 tst handover.py: using LAC 25181 01:57:25.592740 tst handover.py: using RAC 191 01:57:25.717393 tst handover.py: using CellId 25181 01:57:25.843307 tst handover.py: using BVCI 25182 01:57:25.961189 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 01:57:25.972431 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 01:57:25.983428 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 01:57:25.994693 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 01:57:26.005810 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 01:57:26.016866 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 01:57:26.137798 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 01:57:26.255582 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:57:26.763351 run create_hlr_db(pid=11368): Launched 01:57:27.946807 run create_hlr_db(pid=11368): Terminated: ok {rc=0} 01:57:28.289159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11370): Launched 01:57:28.617411 run osmo-hlr_10.42.42.2(pid=11371): Launched 01:57:28.743277 run osmo-stp_10.42.42.5: Starting osmo-stp 01:57:29.307003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11373): Launched 01:57:29.635091 run osmo-stp_10.42.42.5(pid=11374): Launched 01:57:29.761952 run osmo-msc_10.42.42.6: Starting osmo-msc 01:57:30.351868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11376): Launched 01:57:30.680826 run osmo-msc_10.42.42.6(pid=11377): Launched 01:57:30.938373 run osmo-stp_10.42.42.5(pid=11374): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11374)] 01:57:31.160866 run osmo-stp_10.42.42.5(pid=11374): stdout: | (launched: 2022-12-10_01:57:29.575057) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:57:31.441542 run osmo-stp_10.42.42.5(pid=11374): stderr: | 20221210015729769 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015729769 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015729770 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015729770 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015729770 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015729770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015729770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:57:31.581248 run osmo-stp_10.42.42.5(pid=11374): stdout: | (launched: 2022-12-10_01:57:29.575057) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:57:31.707137 run osmo-stp_10.42.42.5(pid=11374): stderr: | 20221210015729769 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015729769 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015729770 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015729770 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015729770 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015729770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015729770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:57:31.858188 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11374): Process ended prematurely: osmo-stp_10.42.42.5(pid=11374) [trial-2367↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11374)] [trial-2367↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 01:57:31.867671 tst handover.py:18: Test FAILED (7.0 sec) 01:57:31.897682 run osmo-hlr_10.42.42.2(pid=11371): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11371)] 01:57:31.948368 run osmo-hlr_10.42.42.2(pid=11371): stdout: | (launched: 2022-12-10_01:57:28.557002) 01:57:32.000731 run osmo-hlr_10.42.42.2(pid=11371): stderr: | 20221210015728759 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015728759 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015728759 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015728759 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015728759 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015728759 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015728771 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015728779 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015728780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015728780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:57:32.074270 run osmo-msc_10.42.42.6(pid=11377): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11377)] 01:57:32.126813 run osmo-msc_10.42.42.6(pid=11377): stdout: | (launched: 2022-12-10_01:57:30.620150) 01:57:32.180576 run osmo-msc_10.42.42.6(pid=11377): stderr: | 20221210015731063 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210015731063 DLGLOBAL DEBUG validating counter group 0x7fdf1abdbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210015731063 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210015731063 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210015731064 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210015731064 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210015731074 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210015731074 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210015731074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210015731075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:57:32.234570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11370): Terminating (SIGTERM) 01:57:32.278049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11373): Terminating (SIGTERM) 01:57:32.322399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11376): Terminating (SIGTERM) 01:57:32.364363 --- ParallelTerminationStrategy: PID 11370 died... 01:57:32.384273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11370): Terminated: ok {rc=0} 01:57:32.430732 --- ParallelTerminationStrategy: PID 11373 died... 01:57:32.450190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11373): Terminated: ok {rc=0} 01:57:32.495833 --- ParallelTerminationStrategy: PID 11376 died... 01:57:32.515205 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11376): Terminated: ok {rc=0} 01:57:32.603170 bus /sierra_3: Setting Powered False 01:57:33.702274 bus /sierra_3: Setting Powered False 01:57:34.820905 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 01:57:36.069642 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:57:36.076062 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 01:57:36.116205 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 01:57:36.142710 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 01:57:36.196058 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 01:57:36.236891 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 01:57:36.263253 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 01:57:36.813589 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 01:57:36.818789 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:57:36.829747 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 01:57:36.867640 tst handover.py: using LAC 25182 01:57:36.986233 tst handover.py: using RAC 192 01:57:37.103614 tst handover.py: using CellId 25182 01:57:37.221463 tst handover.py: using BVCI 25183 01:57:37.332499 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 01:57:37.365373 tst handover.py: using LAC 25183 01:57:37.484331 tst handover.py: using RAC 193 01:57:37.610893 tst handover.py: using CellId 25183 01:57:37.736622 tst handover.py: using BVCI 25184 01:57:37.855875 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:57:37.867257 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:57:37.878379 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:57:37.889725 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:57:37.900881 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:57:37.912098 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 01:57:38.027317 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 01:57:38.141218 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:57:38.587929 run create_hlr_db(pid=11383): Launched 01:57:38.705839 bus /sierra_2: Setting Powered False 01:57:39.765099 run create_hlr_db(pid=11383): Terminated: ok {rc=0} 01:57:40.182194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11385): Launched 01:57:40.512015 run osmo-hlr_10.42.42.2(pid=11386): Launched 01:57:40.637873 run osmo-stp_10.42.42.5: Starting osmo-stp 01:57:41.176599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11388): Launched 01:57:41.505020 run osmo-stp_10.42.42.5(pid=11389): Launched 01:57:41.630395 run osmo-msc_10.42.42.6: Starting osmo-msc 01:57:42.193692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11391): Launched 01:57:42.523023 run osmo-msc_10.42.42.6(pid=11392): Launched 01:57:42.708486 run osmo-stp_10.42.42.5(pid=11389): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11389)] 01:57:42.850036 run osmo-stp_10.42.42.5(pid=11389): stdout: | (launched: 2022-12-10_01:57:41.444295) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:57:42.988323 run osmo-stp_10.42.42.5(pid=11389): stderr: | 20221210015741637 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015741637 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015741637 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015741637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015741640 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015741640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015741640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:57:43.124743 run osmo-stp_10.42.42.5(pid=11389): stdout: | (launched: 2022-12-10_01:57:41.444295) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:57:43.254446 run osmo-stp_10.42.42.5(pid=11389): stderr: | 20221210015741637 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015741637 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015741637 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015741637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015741640 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015741640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015741640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:57:43.409478 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11389): Process ended prematurely: osmo-stp_10.42.42.5(pid=11389) [trial-2367↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11389)] [trial-2367↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 01:57:43.418606 tst handover.py:18: Test FAILED (6.6 sec) 01:57:43.446110 run osmo-hlr_10.42.42.2(pid=11386): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11386)] 01:57:43.495700 run osmo-hlr_10.42.42.2(pid=11386): stdout: | (launched: 2022-12-10_01:57:40.451374) 01:57:43.546978 run osmo-hlr_10.42.42.2(pid=11386): stderr: | 20221210015740652 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015740652 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015740652 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015740652 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015740652 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015740652 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015740664 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015740672 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015740672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015740672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:57:43.618800 run osmo-msc_10.42.42.6(pid=11392): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11392)] 01:57:43.668339 run osmo-msc_10.42.42.6(pid=11392): stdout: | (launched: 2022-12-10_01:57:42.462636) 01:57:43.719463 run osmo-msc_10.42.42.6(pid=11392): stderr: | 20221210015742785 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210015742785 DLGLOBAL DEBUG validating counter group 0x7eff36c17c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210015742785 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210015742785 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210015742786 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210015742786 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210015742787 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210015742788 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210015742788 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210015742788 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:57:43.771190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11385): Terminating (SIGTERM) 01:57:43.812831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11388): Terminating (SIGTERM) 01:57:43.854316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11391): Terminating (SIGTERM) 01:57:43.896067 --- ParallelTerminationStrategy: PID 11385 died... 01:57:43.915931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11385): Terminated: ok {rc=0} 01:57:43.961701 --- ParallelTerminationStrategy: PID 11388 died... 01:57:43.981039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11388): Terminated: ok {rc=0} 01:57:44.026741 --- ParallelTerminationStrategy: PID 11391 died... 01:57:44.046153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11391): Terminated: ok {rc=0} 01:57:44.132464 bus /sierra_3: Setting Powered False 01:57:45.231270 bus /sierra_3: Setting Powered False 01:57:46.346473 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 01:57:47.602497 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:57:47.608354 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 01:57:47.663277 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 01:57:47.690433 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 01:57:47.744138 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 01:57:47.799688 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 01:57:47.827054 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 01:57:48.377211 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 01:57:48.382537 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:57:48.393932 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 01:57:48.432151 tst handover.py: using LAC 25184 01:57:48.559482 tst handover.py: using RAC 194 01:57:48.681348 tst handover.py: using CellId 25184 01:57:48.801378 tst handover.py: using BVCI 25185 01:57:48.914308 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 01:57:48.962383 tst handover.py: using LAC 25185 01:57:49.083542 tst handover.py: using RAC 195 01:57:49.204818 tst handover.py: using CellId 25185 01:57:49.324815 tst handover.py: using BVCI 25186 01:57:49.435363 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:57:49.446243 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:57:49.456776 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:57:49.467911 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:57:49.479089 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:57:49.490133 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 01:57:49.607998 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 01:57:49.724275 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:57:50.172066 run create_hlr_db(pid=11397): Launched 01:57:50.290593 bus /sierra_2: Setting Powered False 01:57:51.350947 run create_hlr_db(pid=11397): Terminated: ok {rc=0} 01:57:51.767331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11399): Launched 01:57:52.095612 run osmo-hlr_10.42.42.2(pid=11400): Launched 01:57:52.222865 run osmo-stp_10.42.42.5: Starting osmo-stp 01:57:52.759030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11402): Launched 01:57:53.087862 run osmo-stp_10.42.42.5(pid=11403): Launched 01:57:53.212938 run osmo-msc_10.42.42.6: Starting osmo-msc 01:57:53.774752 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11405): Launched 01:57:54.102607 run osmo-msc_10.42.42.6(pid=11406): Launched 01:57:54.286664 run osmo-stp_10.42.42.5(pid=11403): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11403)] 01:57:54.424631 run osmo-stp_10.42.42.5(pid=11403): stdout: | (launched: 2022-12-10_01:57:53.027546) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:57:54.562018 run osmo-stp_10.42.42.5(pid=11403): stderr: | 20221210015753221 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015753221 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015753221 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015753222 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015753222 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015753222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015753222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:57:54.697889 run osmo-stp_10.42.42.5(pid=11403): stdout: | (launched: 2022-12-10_01:57:53.027546) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:57:54.827803 run osmo-stp_10.42.42.5(pid=11403): stderr: | 20221210015753221 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015753221 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015753221 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015753222 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015753222 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015753222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015753222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:57:54.983799 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11403): Process ended prematurely: osmo-stp_10.42.42.5(pid=11403) [trial-2367↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11403)] [trial-2367↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 01:57:54.992691 tst handover.py:18: Test FAILED (6.6 sec) 01:57:55.019952 run osmo-hlr_10.42.42.2(pid=11400): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11400)] 01:57:55.069468 run osmo-hlr_10.42.42.2(pid=11400): stdout: | (launched: 2022-12-10_01:57:52.035726) 01:57:55.120828 run osmo-hlr_10.42.42.2(pid=11400): stderr: | 20221210015752235 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015752235 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015752235 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015752235 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015752235 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015752236 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015752249 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015752259 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015752259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015752259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:57:55.192427 run osmo-msc_10.42.42.6(pid=11406): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11406)] 01:57:55.242014 run osmo-msc_10.42.42.6(pid=11406): stdout: | (launched: 2022-12-10_01:57:54.042389) 01:57:55.293238 run osmo-msc_10.42.42.6(pid=11406): stderr: | 20221210015754365 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210015754365 DLGLOBAL DEBUG validating counter group 0x7f67ff9b8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210015754365 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210015754365 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210015754366 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210015754366 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210015754367 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210015754368 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210015754368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210015754368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:57:55.345168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11399): Terminating (SIGTERM) 01:57:55.386549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11402): Terminating (SIGTERM) 01:57:55.427880 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11405): Terminating (SIGTERM) 01:57:55.469497 --- ParallelTerminationStrategy: PID 11399 died... 01:57:55.489295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11399): Terminated: ok {rc=0} 01:57:55.535000 --- ParallelTerminationStrategy: PID 11402 died... 01:57:55.554291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11402): Terminated: ok {rc=0} 01:57:55.599635 --- ParallelTerminationStrategy: PID 11405 died... 01:57:55.618917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11405): Terminated: ok {rc=0} 01:57:55.706162 bus /sierra_3: Setting Powered False 01:57:56.804913 bus /sierra_3: Setting Powered False 01:57:57.920808 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 01:57:59.185111 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:57:59.190683 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 01:57:59.241447 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 01:57:59.268492 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 01:57:59.323782 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 01:57:59.374140 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 01:57:59.400372 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 01:57:59.953432 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 01:57:59.959024 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:57:59.970672 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 01:58:00.011296 tst handover.py: using LAC 25186 01:58:00.141115 tst handover.py: using RAC 196 01:58:00.270447 tst handover.py: using CellId 25186 01:58:00.400251 tst handover.py: using BVCI 25187 01:58:00.518817 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 01:58:00.564638 tst handover.py: using LAC 25187 01:58:00.690820 tst handover.py: using RAC 197 01:58:00.809808 tst handover.py: using CellId 25187 01:58:00.955191 tst handover.py: using BVCI 25188 01:58:01.088327 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:58:01.102887 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:58:01.117577 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:58:01.132470 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:58:01.147184 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:58:01.162147 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 01:58:01.302844 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 01:58:01.424402 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:58:01.890685 run create_hlr_db(pid=11411): Launched 01:58:02.042205 bus /sierra_2: Setting Powered False 01:58:03.103499 run create_hlr_db(pid=11411): Terminated: ok {rc=0} 01:58:03.500343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11413): Launched 01:58:03.806536 run osmo-hlr_10.42.42.2(pid=11414): Launched 01:58:03.923604 run osmo-stp_10.42.42.5: Starting osmo-stp 01:58:04.436000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11416): Launched 01:58:04.742483 run osmo-stp_10.42.42.5(pid=11417): Launched 01:58:04.859387 run osmo-msc_10.42.42.6: Starting osmo-msc 01:58:05.405114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11419): Launched 01:58:05.712069 run osmo-msc_10.42.42.6(pid=11420): Launched 01:58:05.883844 run osmo-stp_10.42.42.5(pid=11417): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11417)] 01:58:06.014533 run osmo-stp_10.42.42.5(pid=11417): stdout: | (launched: 2022-12-10_01:58:04.685848) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:58:06.143856 run osmo-stp_10.42.42.5(pid=11417): stderr: | 20221210015804857 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015804857 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015804857 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015804858 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015804860 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015804860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015804860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:58:06.270806 run osmo-stp_10.42.42.5(pid=11417): stdout: | (launched: 2022-12-10_01:58:04.685848) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:58:06.391795 run osmo-stp_10.42.42.5(pid=11417): stderr: | 20221210015804857 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015804857 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015804857 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015804858 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015804860 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015804860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015804860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:58:06.536845 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11417): Process ended prematurely: osmo-stp_10.42.42.5(pid=11417) [trial-2367↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11417)] [trial-2367↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 01:58:06.545388 tst handover.py:18: Test FAILED (6.6 sec) 01:58:06.571989 run osmo-hlr_10.42.42.2(pid=11414): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11414)] 01:58:06.619465 run osmo-hlr_10.42.42.2(pid=11414): stdout: | (launched: 2022-12-10_01:58:03.749688) 01:58:06.668628 run osmo-hlr_10.42.42.2(pid=11414): stderr: | 20221210015803927 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015803927 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015803927 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015803927 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015803927 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015803927 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015803940 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015803949 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015803949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015803950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:58:06.736909 run osmo-msc_10.42.42.6(pid=11420): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11420)] 01:58:06.784518 run osmo-msc_10.42.42.6(pid=11420): stdout: | (launched: 2022-12-10_01:58:05.655416) 01:58:06.833546 run osmo-msc_10.42.42.6(pid=11420): stderr: | 20221210015805931 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210015805931 DLGLOBAL DEBUG validating counter group 0x7fcba3ac8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210015805932 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210015805932 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210015805932 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210015805932 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210015805934 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210015805934 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210015805934 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210015805934 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:58:06.882982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11413): Terminating (SIGTERM) 01:58:06.922679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11416): Terminating (SIGTERM) 01:58:06.962354 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11419): Terminating (SIGTERM) 01:58:07.002032 --- ParallelTerminationStrategy: PID 11413 died... 01:58:07.021160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11413): Terminated: ok {rc=0} 01:58:07.065233 --- ParallelTerminationStrategy: PID 11416 died... 01:58:07.083662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11416): Terminated: ok {rc=0} 01:58:07.127789 --- ParallelTerminationStrategy: PID 11419 died... 01:58:07.146186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11419): Terminated: ok {rc=0} 01:58:07.231664 bus /sierra_3: Setting Powered False 01:58:08.335809 bus /sierra_3: Setting Powered False 01:58:09.451818 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 01:58:10.711829 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:58:10.716843 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 01:58:10.771323 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 01:58:10.798018 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 01:58:10.850636 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 01:58:10.904036 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 01:58:10.930452 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 01:58:11.481634 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 01:58:11.486873 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:58:11.497958 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 01:58:11.536047 tst handover.py: using LAC 25188 01:58:11.655165 tst handover.py: using RAC 198 01:58:11.776067 tst handover.py: using CellId 25188 01:58:11.895092 tst handover.py: using BVCI 25189 01:58:12.016443 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 01:58:12.067387 tst handover.py: using LAC 25189 01:58:12.197488 tst handover.py: using RAC 199 01:58:12.318832 tst handover.py: using CellId 25189 01:58:12.440019 tst handover.py: using BVCI 25190 01:58:12.550385 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:58:12.561528 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:58:12.572295 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:58:12.583672 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:58:12.594992 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:58:12.606082 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 01:58:12.720068 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 01:58:12.840505 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:58:13.318748 run create_hlr_db(pid=11425): Launched 01:58:13.454684 bus /sierra_2: Setting Powered False 01:58:14.518682 run create_hlr_db(pid=11425): Terminated: ok {rc=0} 01:58:14.928470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11427): Launched 01:58:15.246716 run osmo-hlr_10.42.42.2(pid=11428): Launched 01:58:15.375925 run osmo-stp_10.42.42.5: Starting osmo-stp 01:58:15.937824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11430): Launched 01:58:16.281907 run osmo-stp_10.42.42.5(pid=11431): Launched 01:58:16.531515 run osmo-msc_10.42.42.6: Starting osmo-msc 01:58:17.160325 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11433): Launched 01:58:17.495140 run osmo-msc_10.42.42.6(pid=11434): Launched 01:58:17.679439 run osmo-stp_10.42.42.5(pid=11431): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11431)] 01:58:17.817293 run osmo-stp_10.42.42.5(pid=11431): stdout: | (launched: 2022-12-10_01:58:16.216096) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:58:17.954600 run osmo-stp_10.42.42.5(pid=11431): stderr: | 20221210015816519 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015816519 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015816519 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015816520 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015816520 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015816520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015816520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:58:18.090990 run osmo-stp_10.42.42.5(pid=11431): stdout: | (launched: 2022-12-10_01:58:16.216096) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:58:18.220704 run osmo-stp_10.42.42.5(pid=11431): stderr: | 20221210015816519 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015816519 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015816519 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015816520 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015816520 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015816520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015816520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:58:18.375664 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11431): Process ended prematurely: osmo-stp_10.42.42.5(pid=11431) [trial-2367↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11431)] [trial-2367↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 01:58:18.384751 tst handover.py:18: Test FAILED (6.9 sec) 01:58:18.412419 run osmo-hlr_10.42.42.2(pid=11428): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11428)] 01:58:18.462525 run osmo-hlr_10.42.42.2(pid=11428): stdout: | (launched: 2022-12-10_01:58:15.186760) 01:58:18.514267 run osmo-hlr_10.42.42.2(pid=11428): stderr: | 20221210015815384 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015815384 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015815385 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015815385 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015815385 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015815385 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015815398 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015815406 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015815407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015815407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:58:18.586522 run osmo-msc_10.42.42.6(pid=11434): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11434)] 01:58:18.636459 run osmo-msc_10.42.42.6(pid=11434): stdout: | (launched: 2022-12-10_01:58:17.434980) 01:58:18.689738 run osmo-msc_10.42.42.6(pid=11434): stderr: | 20221210015817760 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210015817760 DLGLOBAL DEBUG validating counter group 0x7fd42a2f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210015817761 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210015817761 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210015817761 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210015817761 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210015817763 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210015817763 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210015817763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210015817763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:58:18.741735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11427): Terminating (SIGTERM) 01:58:18.783955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11430): Terminating (SIGTERM) 01:58:18.825983 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11433): Terminating (SIGTERM) 01:58:18.868143 --- ParallelTerminationStrategy: PID 11427 died... 01:58:18.888208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11427): Terminated: ok {rc=0} 01:58:18.934912 --- ParallelTerminationStrategy: PID 11430 died... 01:58:18.954638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11430): Terminated: ok {rc=0} 01:58:19.000678 --- ParallelTerminationStrategy: PID 11433 died... 01:58:19.020282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11433): Terminated: ok {rc=0} 01:58:19.107875 bus /sierra_3: Setting Powered False 01:58:20.208841 bus /sierra_3: Setting Powered False 01:58:21.325135 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 01:58:22.590766 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:58:22.596438 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 01:58:22.638672 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 01:58:22.665846 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 01:58:22.719576 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 01:58:22.761066 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 01:58:22.787590 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 01:58:23.339406 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 01:58:23.344829 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 01:58:23.356487 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 01:58:23.395071 tst handover.py: using LAC 25190 01:58:23.524046 tst handover.py: using RAC 200 01:58:23.645075 tst handover.py: using CellId 25190 01:58:23.766380 tst handover.py: using BVCI 25191 01:58:23.878977 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 01:58:23.919239 tst handover.py: using LAC 25191 01:58:24.046876 tst handover.py: using RAC 201 01:58:24.173015 tst handover.py: using CellId 25191 01:58:24.299587 tst handover.py: using BVCI 25192 01:58:24.419864 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 01:58:24.431301 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 01:58:24.442583 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 01:58:24.453676 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 01:58:24.464804 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 01:58:24.476040 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 01:58:24.590960 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 01:58:24.706762 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:58:25.154479 run create_hlr_db(pid=11439): Launched 01:58:25.274665 bus /sierra_2: Setting Powered False 01:58:26.335096 run create_hlr_db(pid=11439): Terminated: ok {rc=0} 01:58:26.752252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11441): Launched 01:58:27.079744 run osmo-hlr_10.42.42.2(pid=11442): Launched 01:58:27.204873 run osmo-stp_10.42.42.5: Starting osmo-stp 01:58:27.737034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11444): Launched 01:58:28.064649 run osmo-stp_10.42.42.5(pid=11445): Launched 01:58:28.190794 run osmo-msc_10.42.42.6: Starting osmo-msc 01:58:28.752703 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11447): Launched 01:58:29.082511 run osmo-msc_10.42.42.6(pid=11448): Launched 01:58:29.267883 run osmo-stp_10.42.42.5(pid=11445): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11445)] 01:58:29.406007 run osmo-stp_10.42.42.5(pid=11445): stdout: | (launched: 2022-12-10_01:58:28.004805) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:58:29.543645 run osmo-stp_10.42.42.5(pid=11445): stderr: | 20221210015828199 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015828199 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015828199 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015828200 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015828200 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015828200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015828200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:58:29.679946 run osmo-stp_10.42.42.5(pid=11445): stdout: | (launched: 2022-12-10_01:58:28.004805) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:58:29.809564 run osmo-stp_10.42.42.5(pid=11445): stderr: | 20221210015828199 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015828199 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015828199 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015828200 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015828200 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015828200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015828200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:58:29.964441 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11445): Process ended prematurely: osmo-stp_10.42.42.5(pid=11445) [trial-2367↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11445)] [trial-2367↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 01:58:29.973434 tst handover.py:18: Test FAILED (6.6 sec) 01:58:30.001000 run osmo-hlr_10.42.42.2(pid=11442): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11442)] 01:58:30.050705 run osmo-hlr_10.42.42.2(pid=11442): stdout: | (launched: 2022-12-10_01:58:27.019512) 01:58:30.102190 run osmo-hlr_10.42.42.2(pid=11442): stderr: | 20221210015827220 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015827220 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015827220 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015827220 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015827220 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015827220 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015827232 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015827241 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015827241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015827241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:58:30.174230 run osmo-msc_10.42.42.6(pid=11448): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11448)] 01:58:30.223893 run osmo-msc_10.42.42.6(pid=11448): stdout: | (launched: 2022-12-10_01:58:29.022283) 01:58:30.275051 run osmo-msc_10.42.42.6(pid=11448): stderr: | 20221210015829349 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210015829349 DLGLOBAL DEBUG validating counter group 0x7fb2e2f26c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210015829349 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210015829349 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210015829350 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210015829350 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210015829351 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210015829352 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210015829352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210015829352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:58:30.326826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11441): Terminating (SIGTERM) 01:58:30.368115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11444): Terminating (SIGTERM) 01:58:30.409540 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11447): Terminating (SIGTERM) 01:58:30.451266 --- ParallelTerminationStrategy: PID 11441 died... 01:58:30.470716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11441): Terminated: ok {rc=0} 01:58:30.516403 --- ParallelTerminationStrategy: PID 11444 died... 01:58:30.535807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11444): Terminated: ok {rc=0} 01:58:30.581340 --- ParallelTerminationStrategy: PID 11447 died... 01:58:30.600631 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11447): Terminated: ok {rc=0} 01:58:30.686502 bus /sierra_3: Setting Powered False 01:58:31.791436 bus /sierra_3: Setting Powered False 01:58:32.910154 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 01:58:34.158909 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:58:34.164228 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 01:58:34.217863 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 01:58:34.244277 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 01:58:34.295484 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 01:58:34.347868 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 01:58:34.374114 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 01:58:34.925830 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 01:58:34.931027 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 01:58:34.941887 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 01:58:34.978710 tst handover.py: using LAC 25192 01:58:35.097995 tst handover.py: using RAC 202 01:58:35.217355 tst handover.py: using CellId 25192 01:58:35.338701 tst handover.py: using BVCI 25193 01:58:35.459192 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 01:58:35.510394 tst handover.py: using LAC 25193 01:58:35.639823 tst handover.py: using RAC 203 01:58:35.769488 tst handover.py: using CellId 25193 01:58:35.899647 tst handover.py: using BVCI 25194 01:58:36.020501 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 01:58:36.031979 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 01:58:36.043152 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 01:58:36.054571 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 01:58:36.066023 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 01:58:36.077437 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 01:58:36.195545 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 01:58:36.310009 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:58:36.756566 run create_hlr_db(pid=11453): Launched 01:58:36.873091 bus /sierra_2: Setting Powered False 01:58:37.937216 run create_hlr_db(pid=11453): Terminated: ok {rc=0} 01:58:38.362319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11455): Launched 01:58:38.690069 run osmo-hlr_10.42.42.2(pid=11456): Launched 01:58:38.816702 run osmo-stp_10.42.42.5: Starting osmo-stp 01:58:39.353703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11458): Launched 01:58:39.681917 run osmo-stp_10.42.42.5(pid=11459): Launched 01:58:39.808749 run osmo-msc_10.42.42.6: Starting osmo-msc 01:58:40.371305 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11461): Launched 01:58:40.699915 run osmo-msc_10.42.42.6(pid=11462): Launched 01:58:40.884760 run osmo-stp_10.42.42.5(pid=11459): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11459)] 01:58:41.022677 run osmo-stp_10.42.42.5(pid=11459): stdout: | (launched: 2022-12-10_01:58:39.621580) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:58:41.159666 run osmo-stp_10.42.42.5(pid=11459): stderr: | 20221210015839816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015839817 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015839817 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015839817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015839818 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015839818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015839818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:58:41.295903 run osmo-stp_10.42.42.5(pid=11459): stdout: | (launched: 2022-12-10_01:58:39.621580) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:58:41.425540 run osmo-stp_10.42.42.5(pid=11459): stderr: | 20221210015839816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015839817 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015839817 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015839817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015839818 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015839818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015839818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:58:41.580379 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11459): Process ended prematurely: osmo-stp_10.42.42.5(pid=11459) [trial-2367↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11459)] [trial-2367↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 01:58:41.589399 tst handover.py:18: Test FAILED (6.7 sec) 01:58:41.616586 run osmo-hlr_10.42.42.2(pid=11456): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11456)] 01:58:41.666115 run osmo-hlr_10.42.42.2(pid=11456): stdout: | (launched: 2022-12-10_01:58:38.629789) 01:58:41.717515 run osmo-hlr_10.42.42.2(pid=11456): stderr: | 20221210015838830 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015838830 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015838830 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015838830 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015838830 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015838830 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015838842 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015838852 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015838852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015838852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:58:41.789207 run osmo-msc_10.42.42.6(pid=11462): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11462)] 01:58:41.838915 run osmo-msc_10.42.42.6(pid=11462): stdout: | (launched: 2022-12-10_01:58:40.639537) 01:58:41.890417 run osmo-msc_10.42.42.6(pid=11462): stderr: | 20221210015840964 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210015840964 DLGLOBAL DEBUG validating counter group 0x7f8d28070c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210015840965 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210015840965 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210015840965 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210015840965 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210015840967 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210015840967 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210015840967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210015840967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:58:41.941809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11455): Terminating (SIGTERM) 01:58:41.983197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11458): Terminating (SIGTERM) 01:58:42.024430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11461): Terminating (SIGTERM) 01:58:42.065909 --- ParallelTerminationStrategy: PID 11455 died... 01:58:42.085694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11455): Terminated: ok {rc=0} 01:58:42.131507 --- ParallelTerminationStrategy: PID 11458 died... 01:58:42.150928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11458): Terminated: ok {rc=0} 01:58:42.196283 --- ParallelTerminationStrategy: PID 11461 died... 01:58:42.215800 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11461): Terminated: ok {rc=0} 01:58:42.302270 bus /sierra_3: Setting Powered False 01:58:43.399549 bus /sierra_3: Setting Powered False 01:58:44.514587 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 01:58:45.778449 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:58:45.784132 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 01:58:45.842108 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 01:58:45.877873 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 01:58:45.932318 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 01:58:45.992907 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 01:58:46.021240 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 01:58:46.589779 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 01:58:46.596822 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 01:58:46.609211 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 01:58:46.655179 tst handover.py: using LAC 25194 01:58:46.779117 tst handover.py: using RAC 204 01:58:46.908014 tst handover.py: using CellId 25194 01:58:47.028549 tst handover.py: using BVCI 25195 01:58:47.174021 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 01:58:47.225741 tst handover.py: using LAC 25195 01:58:47.353230 tst handover.py: using RAC 205 01:58:47.481899 tst handover.py: using CellId 25195 01:58:47.602736 tst handover.py: using BVCI 25196 01:58:47.715033 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 01:58:47.726151 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 01:58:47.737135 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 01:58:47.749797 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 01:58:47.761305 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 01:58:47.772031 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 01:58:47.894049 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 01:58:48.014512 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:58:48.492431 run create_hlr_db(pid=11467): Launched 01:58:48.627076 bus /sierra_2: Setting Powered False 01:58:49.690886 run create_hlr_db(pid=11467): Terminated: ok {rc=0} 01:58:50.098740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11469): Launched 01:58:50.406031 run osmo-hlr_10.42.42.2(pid=11470): Launched 01:58:50.523517 run osmo-stp_10.42.42.5: Starting osmo-stp 01:58:51.039791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11472): Launched 01:58:51.346646 run osmo-stp_10.42.42.5(pid=11473): Launched 01:58:51.466529 run osmo-msc_10.42.42.6: Starting osmo-msc 01:58:51.993873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11475): Launched 01:58:52.303420 run osmo-msc_10.42.42.6(pid=11476): Launched 01:58:52.478305 run osmo-stp_10.42.42.5(pid=11473): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11473)] 01:58:52.607560 run osmo-stp_10.42.42.5(pid=11473): stdout: | (launched: 2022-12-10_01:58:51.289866) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:58:52.735775 run osmo-stp_10.42.42.5(pid=11473): stderr: | 20221210015851463 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015851463 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015851463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015851464 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015851464 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015851464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015851464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:58:52.862318 run osmo-stp_10.42.42.5(pid=11473): stdout: | (launched: 2022-12-10_01:58:51.289866) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:58:52.982795 run osmo-stp_10.42.42.5(pid=11473): stderr: | 20221210015851463 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015851463 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015851463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015851464 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015851464 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015851464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015851464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:58:53.127480 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11473): Process ended prematurely: osmo-stp_10.42.42.5(pid=11473) [trial-2367↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11473)] [trial-2367↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 01:58:53.135892 tst handover.py:18: Test FAILED (6.5 sec) 01:58:53.162081 run osmo-hlr_10.42.42.2(pid=11470): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11470)] 01:58:53.209948 run osmo-hlr_10.42.42.2(pid=11470): stdout: | (launched: 2022-12-10_01:58:50.348517) 01:58:53.259180 run osmo-hlr_10.42.42.2(pid=11470): stderr: | 20221210015850528 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015850528 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015850528 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015850528 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015850528 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015850528 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015850540 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015850548 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015850549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015850549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:58:53.327514 run osmo-msc_10.42.42.6(pid=11476): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11476)] 01:58:53.375381 run osmo-msc_10.42.42.6(pid=11476): stdout: | (launched: 2022-12-10_01:58:52.246269) 01:58:53.425274 run osmo-msc_10.42.42.6(pid=11476): stderr: | 20221210015852517 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210015852517 DLGLOBAL DEBUG validating counter group 0x7f72cf807c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210015852517 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210015852517 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210015852517 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210015852517 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210015852519 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210015852520 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210015852520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210015852520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:58:53.474618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11469): Terminating (SIGTERM) 01:58:53.514236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11472): Terminating (SIGTERM) 01:58:53.553737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11475): Terminating (SIGTERM) 01:58:53.593479 --- ParallelTerminationStrategy: PID 11469 died... 01:58:53.612369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11469): Terminated: ok {rc=0} 01:58:53.656395 --- ParallelTerminationStrategy: PID 11472 died... 01:58:53.674972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11472): Terminated: ok {rc=0} 01:58:53.719219 --- ParallelTerminationStrategy: PID 11475 died... 01:58:53.737587 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11475): Terminated: ok {rc=0} 01:58:53.820688 bus /sierra_3: Setting Powered False 01:58:54.918253 bus /sierra_3: Setting Powered False 01:58:56.034462 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 01:58:57.300572 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:58:57.306472 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 01:58:57.344406 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 01:58:57.371686 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 01:58:57.425693 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 01:58:57.463501 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 01:58:57.490404 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 01:58:58.040304 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 01:58:58.046099 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:58:58.057784 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 01:58:58.093675 tst handover.py: using LAC 25196 01:58:58.224696 tst handover.py: using RAC 206 01:58:58.352748 tst handover.py: using CellId 25196 01:58:58.478720 tst handover.py: using BVCI 25197 01:58:58.597292 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 01:58:58.633900 tst handover.py: using LAC 25197 01:58:58.752581 tst handover.py: using RAC 207 01:58:58.870146 tst handover.py: using CellId 25197 01:58:58.988936 tst handover.py: using BVCI 25198 01:58:59.098795 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:58:59.109738 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:58:59.120302 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:58:59.131109 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:58:59.141917 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:58:59.152695 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 01:58:59.271382 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 01:58:59.389301 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:58:59.836525 run create_hlr_db(pid=11482): Launched 01:58:59.952397 bus /sierra_2: Setting Powered False 01:59:01.030871 run create_hlr_db(pid=11482): Terminated: ok {rc=0} 01:59:01.562763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11484): Launched 01:59:01.949662 run osmo-hlr_10.42.42.2(pid=11485): Launched 01:59:02.149356 run osmo-stp_10.42.42.5: Starting osmo-stp 01:59:02.792036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11487): Launched 01:59:03.123020 run osmo-stp_10.42.42.5(pid=11488): Launched 01:59:03.250332 run osmo-msc_10.42.42.6: Starting osmo-msc 01:59:03.821834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11490): Launched 01:59:04.150012 run osmo-msc_10.42.42.6(pid=11491): Launched 01:59:04.332391 run osmo-stp_10.42.42.5(pid=11488): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11488)] 01:59:04.470731 run osmo-stp_10.42.42.5(pid=11488): stdout: | (launched: 2022-12-10_01:59:03.062486) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:59:04.608209 run osmo-stp_10.42.42.5(pid=11488): stderr: | 20221210015903257 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015903257 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015903258 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015903258 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015903258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015903258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015903259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:59:04.745483 run osmo-stp_10.42.42.5(pid=11488): stdout: | (launched: 2022-12-10_01:59:03.062486) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:59:04.875919 run osmo-stp_10.42.42.5(pid=11488): stderr: | 20221210015903257 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015903257 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015903258 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015903258 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015903258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015903258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015903259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:59:05.031158 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11488): Process ended prematurely: osmo-stp_10.42.42.5(pid=11488) [trial-2367↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11488)] [trial-2367↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 01:59:05.040182 tst handover.py:18: Test FAILED (7.0 sec) 01:59:05.067846 run osmo-hlr_10.42.42.2(pid=11485): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11485)] 01:59:05.118284 run osmo-hlr_10.42.42.2(pid=11485): stdout: | (launched: 2022-12-10_01:59:01.891471) 01:59:05.170270 run osmo-hlr_10.42.42.2(pid=11485): stderr: | 20221210015902263 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015902263 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015902263 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015902263 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015902263 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015902263 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015902284 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015902304 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015902304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015902311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:59:05.242748 run osmo-msc_10.42.42.6(pid=11491): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11491)] 01:59:05.292857 run osmo-msc_10.42.42.6(pid=11491): stdout: | (launched: 2022-12-10_01:59:04.089076) 01:59:05.344690 run osmo-msc_10.42.42.6(pid=11491): stderr: | 20221210015904413 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210015904413 DLGLOBAL DEBUG validating counter group 0x7ffa01de9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210015904413 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210015904413 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210015904413 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210015904414 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210015904415 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210015904416 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210015904416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210015904416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:59:05.396398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11484): Terminating (SIGTERM) 01:59:05.438004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11487): Terminating (SIGTERM) 01:59:05.479504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11490): Terminating (SIGTERM) 01:59:05.521737 --- ParallelTerminationStrategy: PID 11484 died... 01:59:05.541711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11484): Terminated: ok {rc=0} 01:59:05.588003 --- ParallelTerminationStrategy: PID 11487 died... 01:59:05.607416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11487): Terminated: ok {rc=0} 01:59:05.653445 --- ParallelTerminationStrategy: PID 11490 died... 01:59:05.672918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11490): Terminated: ok {rc=0} 01:59:05.760141 bus /sierra_3: Setting Powered False 01:59:06.858232 bus /sierra_3: Setting Powered False 01:59:07.973487 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 01:59:09.219422 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:59:09.225291 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 01:59:09.277324 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 01:59:09.304839 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 01:59:09.356404 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 01:59:09.406192 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 01:59:09.432250 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 01:59:09.984497 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 01:59:09.989843 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:59:10.000527 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 01:59:10.035036 tst handover.py: using LAC 25198 01:59:10.152709 tst handover.py: using RAC 208 01:59:10.270147 tst handover.py: using CellId 25198 01:59:10.390008 tst handover.py: using BVCI 25199 01:59:10.501962 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 01:59:10.548733 tst handover.py: using LAC 25199 01:59:10.676159 tst handover.py: using RAC 209 01:59:10.802279 tst handover.py: using CellId 25199 01:59:10.928781 tst handover.py: using BVCI 25200 01:59:11.047024 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:59:11.058592 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:59:11.069900 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:59:11.081350 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:59:11.092550 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:59:11.103819 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 01:59:11.220568 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 01:59:11.336477 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:59:11.785026 run create_hlr_db(pid=11496): Launched 01:59:11.903128 bus /sierra_2: Setting Powered False 01:59:12.963410 run create_hlr_db(pid=11496): Terminated: ok {rc=0} 01:59:13.382360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11498): Launched 01:59:13.713446 run osmo-hlr_10.42.42.2(pid=11499): Launched 01:59:13.839390 run osmo-stp_10.42.42.5: Starting osmo-stp 01:59:14.378569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11501): Launched 01:59:14.705813 run osmo-stp_10.42.42.5(pid=11502): Launched 01:59:14.832439 run osmo-msc_10.42.42.6: Starting osmo-msc 01:59:15.395668 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11504): Launched 01:59:15.725852 run osmo-msc_10.42.42.6(pid=11505): Launched 01:59:15.998909 run osmo-stp_10.42.42.5(pid=11502): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11502)] 01:59:16.379730 run osmo-stp_10.42.42.5(pid=11502): stdout: | (launched: 2022-12-10_01:59:14.645676) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:59:16.664819 run osmo-stp_10.42.42.5(pid=11502): stderr: | 20221210015914840 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015914840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015914840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015914841 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015914841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015914841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015914841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:59:16.802796 run osmo-stp_10.42.42.5(pid=11502): stdout: | (launched: 2022-12-10_01:59:14.645676) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:59:16.935481 run osmo-stp_10.42.42.5(pid=11502): stderr: | 20221210015914840 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015914840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015914840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015914841 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015914841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015914841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015914841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:59:17.093249 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11502): Process ended prematurely: osmo-stp_10.42.42.5(pid=11502) [trial-2367↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11502)] [trial-2367↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 01:59:17.102908 tst handover.py:18: Test FAILED (7.1 sec) 01:59:17.131588 run osmo-hlr_10.42.42.2(pid=11499): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11499)] 01:59:17.182535 run osmo-hlr_10.42.42.2(pid=11499): stdout: | (launched: 2022-12-10_01:59:13.652747) 01:59:17.235352 run osmo-hlr_10.42.42.2(pid=11499): stderr: | 20221210015913853 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015913853 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015913853 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015913853 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015913854 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015913854 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015913867 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015913875 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015913875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015913875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:59:17.308250 run osmo-msc_10.42.42.6(pid=11505): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11505)] 01:59:17.359087 run osmo-msc_10.42.42.6(pid=11505): stdout: | (launched: 2022-12-10_01:59:15.664331) 01:59:17.411254 run osmo-msc_10.42.42.6(pid=11505): stderr: | 20221210015916083 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210015916083 DLGLOBAL DEBUG validating counter group 0x7fc932a19c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210015916083 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210015916083 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210015916084 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210015916084 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210015916087 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210015916088 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210015916089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210015916090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:59:17.463416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11498): Terminating (SIGTERM) 01:59:17.505299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11501): Terminating (SIGTERM) 01:59:17.547015 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11504): Terminating (SIGTERM) 01:59:17.589415 --- ParallelTerminationStrategy: PID 11498 died... 01:59:17.609543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11498): Terminated: ok {rc=0} 01:59:17.655645 --- ParallelTerminationStrategy: PID 11501 died... 01:59:17.675252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11501): Terminated: ok {rc=0} 01:59:17.721217 --- ParallelTerminationStrategy: PID 11504 died... 01:59:17.740788 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11504): Terminated: ok {rc=0} 01:59:17.827910 bus /sierra_3: Setting Powered False 01:59:18.927633 bus /sierra_3: Setting Powered False 01:59:20.042621 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 01:59:21.302087 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:59:21.307833 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 01:59:21.355727 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 01:59:21.383213 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 01:59:21.437156 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 01:59:21.485676 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 01:59:21.513087 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 01:59:22.065791 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 01:59:22.071405 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:59:22.083142 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 01:59:22.119133 tst handover.py: using LAC 25200 01:59:22.247687 tst handover.py: using RAC 210 01:59:22.375716 tst handover.py: using CellId 25200 01:59:22.503172 tst handover.py: using BVCI 25201 01:59:22.622080 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 01:59:22.668803 tst handover.py: using LAC 25201 01:59:22.797590 tst handover.py: using RAC 211 01:59:22.925623 tst handover.py: using CellId 25201 01:59:23.053741 tst handover.py: using BVCI 25202 01:59:23.172372 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:59:23.183883 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:59:23.195164 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:59:23.206729 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:59:23.218329 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:59:23.230066 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 01:59:23.345309 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 01:59:23.465990 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:59:23.947287 run create_hlr_db(pid=11510): Launched 01:59:24.080774 bus /sierra_2: Setting Powered False 01:59:25.145490 run create_hlr_db(pid=11510): Terminated: ok {rc=0} 01:59:25.572439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11512): Launched 01:59:25.904234 run osmo-hlr_10.42.42.2(pid=11513): Launched 01:59:26.031965 run osmo-stp_10.42.42.5: Starting osmo-stp 01:59:26.571445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11515): Launched 01:59:26.901324 run osmo-stp_10.42.42.5(pid=11516): Launched 01:59:27.027390 run osmo-msc_10.42.42.6: Starting osmo-msc 01:59:27.597859 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11518): Launched 01:59:27.927261 run osmo-msc_10.42.42.6(pid=11519): Launched 01:59:28.112082 run osmo-stp_10.42.42.5(pid=11516): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11516)] 01:59:28.250750 run osmo-stp_10.42.42.5(pid=11516): stdout: | (launched: 2022-12-10_01:59:26.840733) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:59:28.389157 run osmo-stp_10.42.42.5(pid=11516): stderr: | 20221210015927034 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015927034 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015927035 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015927035 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015927035 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015927035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015927035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:59:28.526235 run osmo-stp_10.42.42.5(pid=11516): stdout: | (launched: 2022-12-10_01:59:26.840733) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:59:28.656431 run osmo-stp_10.42.42.5(pid=11516): stderr: | 20221210015927034 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015927034 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015927035 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015927035 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015927035 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015927035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015927035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:59:28.812341 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11516): Process ended prematurely: osmo-stp_10.42.42.5(pid=11516) [trial-2367↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11516)] [trial-2367↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 01:59:28.821695 tst handover.py:18: Test FAILED (6.7 sec) 01:59:28.849528 run osmo-hlr_10.42.42.2(pid=11513): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11513)] 01:59:28.900005 run osmo-hlr_10.42.42.2(pid=11513): stdout: | (launched: 2022-12-10_01:59:25.843537) 01:59:28.952161 run osmo-hlr_10.42.42.2(pid=11513): stderr: | 20221210015926045 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015926045 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015926045 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015926045 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015926045 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015926045 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015926062 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015926071 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015926072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015926072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:59:29.024877 run osmo-msc_10.42.42.6(pid=11519): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11519)] 01:59:29.075141 run osmo-msc_10.42.42.6(pid=11519): stdout: | (launched: 2022-12-10_01:59:27.866835) 01:59:29.127123 run osmo-msc_10.42.42.6(pid=11519): stderr: | 20221210015928191 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210015928191 DLGLOBAL DEBUG validating counter group 0x7fa5fd892c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210015928191 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210015928191 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210015928192 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210015928192 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210015928193 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210015928194 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210015928194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210015928194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:59:29.179527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11512): Terminating (SIGTERM) 01:59:29.221258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11515): Terminating (SIGTERM) 01:59:29.263143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11518): Terminating (SIGTERM) 01:59:29.305467 --- ParallelTerminationStrategy: PID 11512 died... 01:59:29.325586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11512): Terminated: ok {rc=0} 01:59:29.371916 --- ParallelTerminationStrategy: PID 11515 died... 01:59:29.391465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11515): Terminated: ok {rc=0} 01:59:29.437650 --- ParallelTerminationStrategy: PID 11518 died... 01:59:29.457301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11518): Terminated: ok {rc=0} 01:59:29.545651 bus /sierra_3: Setting Powered False 01:59:30.646222 bus /sierra_3: Setting Powered False 01:59:31.778555 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 01:59:33.050079 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:59:33.055397 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 01:59:33.109600 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 01:59:33.136643 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 01:59:33.190608 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 01:59:33.242897 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 01:59:33.269850 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 01:59:33.827159 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 01:59:33.833360 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:59:33.845444 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 01:59:33.884248 tst handover.py: using LAC 25202 01:59:34.011494 tst handover.py: using RAC 212 01:59:34.138617 tst handover.py: using CellId 25202 01:59:34.265681 tst handover.py: using BVCI 25203 01:59:34.387069 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 01:59:34.435893 tst handover.py: using LAC 25203 01:59:34.562304 tst handover.py: using RAC 213 01:59:34.688454 tst handover.py: using CellId 25203 01:59:34.815248 tst handover.py: using BVCI 25204 01:59:34.934055 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:59:34.945580 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:59:34.956703 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:59:34.968027 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:59:34.979307 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:59:34.990557 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 01:59:35.105675 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 01:59:35.224018 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:59:35.703781 run create_hlr_db(pid=11525): Launched 01:59:35.838582 bus /sierra_2: Setting Powered False 01:59:36.902592 run create_hlr_db(pid=11525): Terminated: ok {rc=0} 01:59:37.330092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11527): Launched 01:59:37.660422 run osmo-hlr_10.42.42.2(pid=11528): Launched 01:59:37.786719 run osmo-stp_10.42.42.5: Starting osmo-stp 01:59:38.326863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11530): Launched 01:59:38.655112 run osmo-stp_10.42.42.5(pid=11531): Launched 01:59:38.782035 run osmo-msc_10.42.42.6: Starting osmo-msc 01:59:39.345924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11533): Launched 01:59:39.674323 run osmo-msc_10.42.42.6(pid=11534): Launched 01:59:39.859582 run osmo-stp_10.42.42.5(pid=11531): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11531)] 01:59:39.999297 run osmo-stp_10.42.42.5(pid=11531): stdout: | (launched: 2022-12-10_01:59:38.594703) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:59:40.137228 run osmo-stp_10.42.42.5(pid=11531): stderr: | 20221210015938791 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015938791 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015938791 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015938792 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015938792 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015938792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015938792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:59:40.273751 run osmo-stp_10.42.42.5(pid=11531): stdout: | (launched: 2022-12-10_01:59:38.594703) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:59:40.403454 run osmo-stp_10.42.42.5(pid=11531): stderr: | 20221210015938791 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015938791 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015938791 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015938792 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015938792 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015938792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015938792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:59:40.558509 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11531): Process ended prematurely: osmo-stp_10.42.42.5(pid=11531) [trial-2367↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11531)] [trial-2367↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 01:59:40.567319 tst handover.py:18: Test FAILED (6.7 sec) 01:59:40.594875 run osmo-hlr_10.42.42.2(pid=11528): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11528)] 01:59:40.644866 run osmo-hlr_10.42.42.2(pid=11528): stdout: | (launched: 2022-12-10_01:59:37.599894) 01:59:40.696537 run osmo-hlr_10.42.42.2(pid=11528): stderr: | 20221210015937800 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015937800 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015937800 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015937800 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015937800 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015937800 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015937812 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015937821 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015937821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015937821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:59:40.768551 run osmo-msc_10.42.42.6(pid=11534): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11534)] 01:59:40.818149 run osmo-msc_10.42.42.6(pid=11534): stdout: | (launched: 2022-12-10_01:59:39.613785) 01:59:40.869818 run osmo-msc_10.42.42.6(pid=11534): stderr: | 20221210015939937 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210015939937 DLGLOBAL DEBUG validating counter group 0x7f50f661bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210015939937 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210015939937 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210015939937 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210015939937 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210015939939 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210015939939 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210015939939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210015939940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:59:40.921612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11527): Terminating (SIGTERM) 01:59:40.962894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11530): Terminating (SIGTERM) 01:59:41.004435 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11533): Terminating (SIGTERM) 01:59:41.046641 --- ParallelTerminationStrategy: PID 11527 died... 01:59:41.066582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11527): Terminated: ok {rc=0} 01:59:41.112710 --- ParallelTerminationStrategy: PID 11530 died... 01:59:41.132238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11530): Terminated: ok {rc=0} 01:59:41.178348 --- ParallelTerminationStrategy: PID 11533 died... 01:59:41.197842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11533): Terminated: ok {rc=0} 01:59:41.285402 bus /sierra_3: Setting Powered False 01:59:42.384014 bus /sierra_3: Setting Powered False 01:59:43.500316 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 01:59:44.757503 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:59:44.762623 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 01:59:44.801910 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 01:59:44.828305 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 01:59:44.883082 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 01:59:44.922569 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 01:59:44.949823 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 01:59:45.494791 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 01:59:45.500305 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 01:59:45.511268 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 01:59:45.546414 tst handover.py: using LAC 25204 01:59:45.668186 tst handover.py: using RAC 214 01:59:45.788508 tst handover.py: using CellId 25204 01:59:45.939172 tst handover.py: using BVCI 25205 01:59:46.061383 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 01:59:46.097970 tst handover.py: using LAC 25205 01:59:46.221117 tst handover.py: using RAC 215 01:59:46.386957 tst handover.py: using CellId 25205 01:59:46.546037 tst handover.py: using BVCI 25206 01:59:46.691978 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 01:59:46.703767 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 01:59:46.715333 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 01:59:46.728077 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 01:59:46.741812 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 01:59:46.753484 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 01:59:46.872436 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 01:59:47.021687 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:59:47.516332 run create_hlr_db(pid=11539): Launched 01:59:47.652209 bus /sierra_2: Setting Powered False 01:59:48.716921 run create_hlr_db(pid=11539): Terminated: ok {rc=0} 01:59:49.143399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11541): Launched 01:59:49.473740 run osmo-hlr_10.42.42.2(pid=11542): Launched 01:59:49.602738 run osmo-stp_10.42.42.5: Starting osmo-stp 01:59:50.139189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11544): Launched 01:59:50.467210 run osmo-stp_10.42.42.5(pid=11545): Launched 01:59:50.593181 run osmo-msc_10.42.42.6: Starting osmo-msc 01:59:51.158695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11547): Launched 01:59:51.489199 run osmo-msc_10.42.42.6(pid=11548): Launched 01:59:51.675223 run osmo-stp_10.42.42.5(pid=11545): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11545)] 01:59:51.814533 run osmo-stp_10.42.42.5(pid=11545): stdout: | (launched: 2022-12-10_01:59:50.406948) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:59:51.955190 run osmo-stp_10.42.42.5(pid=11545): stderr: | 20221210015950602 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015950602 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015950603 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015950603 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015950604 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015950604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015950604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:59:52.092336 run osmo-stp_10.42.42.5(pid=11545): stdout: | (launched: 2022-12-10_01:59:50.406948) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:59:52.222365 run osmo-stp_10.42.42.5(pid=11545): stderr: | 20221210015950602 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210015950602 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210015950603 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210015950603 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210015950604 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210015950604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210015950604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:59:52.378326 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11545): Process ended prematurely: osmo-stp_10.42.42.5(pid=11545) [trial-2367↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11545)] [trial-2367↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 01:59:52.387317 tst handover.py:18: Test FAILED (6.9 sec) 01:59:52.415313 run osmo-hlr_10.42.42.2(pid=11542): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11542)] 01:59:52.466041 run osmo-hlr_10.42.42.2(pid=11542): stdout: | (launched: 2022-12-10_01:59:49.413079) 01:59:52.518359 run osmo-hlr_10.42.42.2(pid=11542): stderr: | 20221210015949615 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210015949615 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210015949615 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210015949615 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210015949615 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210015949615 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210015949628 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210015949638 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210015949639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210015949639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:59:52.591523 run osmo-msc_10.42.42.6(pid=11548): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11548)] 01:59:52.641866 run osmo-msc_10.42.42.6(pid=11548): stdout: | (launched: 2022-12-10_01:59:51.428359) 01:59:52.693562 run osmo-msc_10.42.42.6(pid=11548): stderr: | 20221210015951754 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210015951754 DLGLOBAL DEBUG validating counter group 0x7f3a3b5b1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210015951754 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210015951754 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210015951754 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210015951755 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210015951756 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210015951757 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210015951757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210015951757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:59:52.745495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11541): Terminating (SIGTERM) 01:59:52.787113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11544): Terminating (SIGTERM) 01:59:52.829135 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11547): Terminating (SIGTERM) 01:59:52.871038 --- ParallelTerminationStrategy: PID 11541 died... 01:59:52.891233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11541): Terminated: ok {rc=0} 01:59:52.937771 --- ParallelTerminationStrategy: PID 11544 died... 01:59:52.957411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11544): Terminated: ok {rc=0} 01:59:53.003416 --- ParallelTerminationStrategy: PID 11547 died... 01:59:53.022932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11547): Terminated: ok {rc=0} 01:59:53.111193 bus /sierra_3: Setting Powered False 01:59:54.211149 bus /sierra_3: Setting Powered False 01:59:55.326706 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 01:59:56.570829 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:59:56.576577 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 01:59:56.628074 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 01:59:56.655428 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 01:59:56.710219 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 01:59:56.762050 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 01:59:56.789287 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 01:59:57.342675 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 01:59:57.348386 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 01:59:57.359662 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 01:59:57.394946 tst handover.py: using LAC 25206 01:59:57.523891 tst handover.py: using RAC 216 01:59:57.653582 tst handover.py: using CellId 25206 01:59:57.784294 tst handover.py: using BVCI 25207 01:59:57.905508 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 01:59:57.956032 tst handover.py: using LAC 25207 01:59:58.085964 tst handover.py: using RAC 217 01:59:58.214677 tst handover.py: using CellId 25207 01:59:58.344756 tst handover.py: using BVCI 25208 01:59:58.457223 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 01:59:58.468234 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 01:59:58.479043 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 01:59:58.489948 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 01:59:58.500935 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 01:59:58.511883 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 01:59:58.631457 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 01:59:58.751189 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:59:59.232453 run create_hlr_db(pid=11554): Launched 01:59:59.368494 bus /sierra_2: Setting Powered False 02:00:00.433492 run create_hlr_db(pid=11554): Terminated: ok {rc=0} 02:00:00.881799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11556): Launched 02:00:01.227604 run osmo-hlr_10.42.42.2(pid=11557): Launched 02:00:01.486153 run osmo-stp_10.42.42.5: Starting osmo-stp 02:00:02.141653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11562): Launched 02:00:02.459947 run osmo-stp_10.42.42.5(pid=11563): Launched 02:00:02.580899 run osmo-msc_10.42.42.6: Starting osmo-msc 02:00:03.111839 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11565): Launched 02:00:03.419205 run osmo-msc_10.42.42.6(pid=11566): Launched 02:00:03.592671 run osmo-stp_10.42.42.5(pid=11563): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11563)] 02:00:03.722643 run osmo-stp_10.42.42.5(pid=11563): stdout: | (launched: 2022-12-10_02:00:02.402821) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:00:03.852317 run osmo-stp_10.42.42.5(pid=11563): stderr: | 20221210020002573 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020002573 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020002574 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020002574 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020002576 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020002576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020002576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:00:03.980037 run osmo-stp_10.42.42.5(pid=11563): stdout: | (launched: 2022-12-10_02:00:02.402821) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:00:04.101631 run osmo-stp_10.42.42.5(pid=11563): stderr: | 20221210020002573 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020002573 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020002574 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020002574 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020002576 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020002576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020002576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:00:04.247728 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11563): Process ended prematurely: osmo-stp_10.42.42.5(pid=11563) [trial-2367↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11563)] [trial-2367↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 02:00:04.256147 tst handover.py:18: Test FAILED (6.9 sec) 02:00:04.282691 run osmo-hlr_10.42.42.2(pid=11557): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11557)] 02:00:04.330887 run osmo-hlr_10.42.42.2(pid=11557): stdout: | (launched: 2022-12-10_02:00:01.165693) 02:00:04.380716 run osmo-hlr_10.42.42.2(pid=11557): stderr: | 20221210020001513 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210020001513 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210020001513 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210020001513 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210020001513 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210020001513 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210020001528 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210020001536 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210020001536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210020001536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:00:04.449947 run osmo-msc_10.42.42.6(pid=11566): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11566)] 02:00:04.497618 run osmo-msc_10.42.42.6(pid=11566): stdout: | (launched: 2022-12-10_02:00:03.362402) 02:00:04.547589 run osmo-msc_10.42.42.6(pid=11566): stderr: | 20221210020003637 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210020003637 DLGLOBAL DEBUG validating counter group 0x7f0ca23c1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210020003637 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210020003637 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210020003637 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210020003638 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210020003639 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210020003640 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210020003640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210020003640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:00:04.597649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11556): Terminating (SIGTERM) 02:00:04.637331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11562): Terminating (SIGTERM) 02:00:04.676941 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11565): Terminating (SIGTERM) 02:00:04.717054 --- ParallelTerminationStrategy: PID 11556 died... 02:00:04.736173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11556): Terminated: ok {rc=0} 02:00:04.780480 --- ParallelTerminationStrategy: PID 11562 died... 02:00:04.798933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11562): Terminated: ok {rc=0} 02:00:04.843029 --- ParallelTerminationStrategy: PID 11565 died... 02:00:04.861505 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11565): Terminated: ok {rc=0} 02:00:04.947837 bus /sierra_3: Setting Powered False 02:00:06.048080 bus /sierra_3: Setting Powered False 02:00:07.164138 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 02:00:08.424447 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:00:08.430108 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 02:00:08.481139 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 02:00:08.508346 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 02:00:08.562685 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 02:00:08.613680 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 02:00:08.640735 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 02:00:09.190718 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 02:00:09.196028 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:00:09.207193 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:00:09.241880 tst handover.py: using LAC 25208 02:00:09.369433 tst handover.py: using RAC 218 02:00:09.498338 tst handover.py: using CellId 25208 02:00:09.627153 tst handover.py: using BVCI 25209 02:00:09.747390 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:00:09.795842 tst handover.py: using LAC 25209 02:00:09.920647 tst handover.py: using RAC 219 02:00:10.041359 tst handover.py: using CellId 25209 02:00:10.161391 tst handover.py: using BVCI 25210 02:00:10.274252 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:00:10.285249 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:00:10.295824 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:00:10.306727 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:00:10.317717 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:00:10.328765 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:00:10.447316 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:00:10.563280 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:00:11.012435 run create_hlr_db(pid=11572): Launched 02:00:11.129799 bus /sierra_2: Setting Powered False 02:00:12.189879 run create_hlr_db(pid=11572): Terminated: ok {rc=0} 02:00:12.608673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11574): Launched 02:00:12.937668 run osmo-hlr_10.42.42.2(pid=11575): Launched 02:00:13.064527 run osmo-stp_10.42.42.5: Starting osmo-stp 02:00:13.600416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11577): Launched 02:00:13.929612 run osmo-stp_10.42.42.5(pid=11578): Launched 02:00:14.056454 run osmo-msc_10.42.42.6: Starting osmo-msc 02:00:14.622919 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11580): Launched 02:00:14.953516 run osmo-msc_10.42.42.6(pid=11581): Launched 02:00:15.138711 run osmo-stp_10.42.42.5(pid=11578): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11578)] 02:00:15.277552 run osmo-stp_10.42.42.5(pid=11578): stdout: | (launched: 2022-12-10_02:00:13.869244) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:00:15.416306 run osmo-stp_10.42.42.5(pid=11578): stderr: | 20221210020014064 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020014064 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020014064 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020014065 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020014065 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020014065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020014065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:00:15.553324 run osmo-stp_10.42.42.5(pid=11578): stdout: | (launched: 2022-12-10_02:00:13.869244) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:00:15.683418 run osmo-stp_10.42.42.5(pid=11578): stderr: | 20221210020014064 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020014064 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020014064 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020014065 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020014065 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020014065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020014065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:00:15.847696 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11578): Process ended prematurely: osmo-stp_10.42.42.5(pid=11578) [trial-2367↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11578)] [trial-2367↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 02:00:15.859887 tst handover.py:18: Test FAILED (6.7 sec) 02:00:15.889951 run osmo-hlr_10.42.42.2(pid=11575): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11575)] 02:00:15.940758 run osmo-hlr_10.42.42.2(pid=11575): stdout: | (launched: 2022-12-10_02:00:12.877190) 02:00:15.992562 run osmo-hlr_10.42.42.2(pid=11575): stderr: | 20221210020013080 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210020013080 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210020013080 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210020013080 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210020013080 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210020013080 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210020013101 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210020013110 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210020013111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210020013111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:00:16.074292 run osmo-msc_10.42.42.6(pid=11581): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11581)] 02:00:16.124185 run osmo-msc_10.42.42.6(pid=11581): stdout: | (launched: 2022-12-10_02:00:14.892853) 02:00:16.176597 run osmo-msc_10.42.42.6(pid=11581): stderr: | 20221210020015218 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210020015219 DLGLOBAL DEBUG validating counter group 0x7f29ac130c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210020015219 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210020015219 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210020015219 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210020015219 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210020015221 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210020015221 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210020015222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210020015222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:00:16.228887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11574): Terminating (SIGTERM) 02:00:16.272777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11577): Terminating (SIGTERM) 02:00:16.317143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11580): Terminating (SIGTERM) 02:00:16.362751 --- ParallelTerminationStrategy: PID 11574 died... 02:00:16.383803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11574): Terminated: ok {rc=0} 02:00:16.433276 --- ParallelTerminationStrategy: PID 11577 died... 02:00:16.453128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11577): Terminated: ok {rc=0} 02:00:16.501819 --- ParallelTerminationStrategy: PID 11580 died... 02:00:16.521659 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11580): Terminated: ok {rc=0} 02:00:16.614555 bus /sierra_3: Setting Powered False 02:00:17.720108 bus /sierra_3: Setting Powered False 02:00:18.836852 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 02:00:20.090191 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:00:20.096274 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 02:00:20.146086 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 02:00:20.173380 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 02:00:20.226964 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 02:00:20.277271 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 02:00:20.304425 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 02:00:20.851338 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 02:00:20.856861 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 02:00:20.868048 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 02:00:20.902336 tst handover.py: using LAC 25210 02:00:21.024264 tst handover.py: using RAC 220 02:00:21.144142 tst handover.py: using CellId 25210 02:00:21.266661 tst handover.py: using BVCI 25211 02:00:21.379662 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 02:00:21.427930 tst handover.py: using LAC 25211 02:00:21.557128 tst handover.py: using RAC 221 02:00:21.686278 tst handover.py: using CellId 25211 02:00:21.813724 tst handover.py: using BVCI 25212 02:00:21.935777 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 02:00:21.947222 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 02:00:21.958584 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 02:00:21.970265 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 02:00:21.981702 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 02:00:21.992928 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 02:00:22.111985 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 02:00:22.233600 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:00:22.714474 run create_hlr_db(pid=11586): Launched 02:00:22.849483 bus /sierra_2: Setting Powered False 02:00:23.914046 run create_hlr_db(pid=11586): Terminated: ok {rc=0} 02:00:24.342149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11588): Launched 02:00:24.672491 run osmo-hlr_10.42.42.2(pid=11589): Launched 02:00:24.799184 run osmo-stp_10.42.42.5: Starting osmo-stp 02:00:25.334210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11591): Launched 02:00:25.664767 run osmo-stp_10.42.42.5(pid=11592): Launched 02:00:25.793619 run osmo-msc_10.42.42.6: Starting osmo-msc 02:00:26.362662 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11594): Launched 02:00:26.692598 run osmo-msc_10.42.42.6(pid=11595): Launched 02:00:26.876903 run osmo-stp_10.42.42.5(pid=11592): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11592)] 02:00:27.015854 run osmo-stp_10.42.42.5(pid=11592): stdout: | (launched: 2022-12-10_02:00:25.603594) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:00:27.154530 run osmo-stp_10.42.42.5(pid=11592): stderr: | 20221210020025799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020025799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020025800 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020025800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020025800 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020025800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020025801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:00:27.291513 run osmo-stp_10.42.42.5(pid=11592): stdout: | (launched: 2022-12-10_02:00:25.603594) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:00:27.421783 run osmo-stp_10.42.42.5(pid=11592): stderr: | 20221210020025799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020025799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020025800 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020025800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020025800 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020025800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020025801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:00:27.577922 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11592): Process ended prematurely: osmo-stp_10.42.42.5(pid=11592) [trial-2367↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11592)] [trial-2367↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 02:00:27.586751 tst handover.py:18: Test FAILED (6.7 sec) 02:00:27.614566 run osmo-hlr_10.42.42.2(pid=11589): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11589)] 02:00:27.664743 run osmo-hlr_10.42.42.2(pid=11589): stdout: | (launched: 2022-12-10_02:00:24.611954) 02:00:27.716683 run osmo-hlr_10.42.42.2(pid=11589): stderr: | 20221210020024810 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210020024811 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210020024811 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210020024811 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210020024811 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210020024811 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210020024842 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210020024853 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210020024853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210020024854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:00:27.789025 run osmo-msc_10.42.42.6(pid=11595): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11595)] 02:00:27.838860 run osmo-msc_10.42.42.6(pid=11595): stdout: | (launched: 2022-12-10_02:00:26.631499) 02:00:27.890390 run osmo-msc_10.42.42.6(pid=11595): stderr: | 20221210020026954 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210020026955 DLGLOBAL DEBUG validating counter group 0x7f05155e5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210020026955 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210020026955 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210020026955 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210020026955 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210020026957 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210020026957 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210020026957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210020026958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:00:27.941806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11588): Terminating (SIGTERM) 02:00:27.983201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11591): Terminating (SIGTERM) 02:00:28.024865 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11594): Terminating (SIGTERM) 02:00:28.067320 --- ParallelTerminationStrategy: PID 11588 died... 02:00:28.087329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11588): Terminated: ok {rc=0} 02:00:28.133258 --- ParallelTerminationStrategy: PID 11591 died... 02:00:28.153117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11591): Terminated: ok {rc=0} 02:00:28.199012 --- ParallelTerminationStrategy: PID 11594 died... 02:00:28.218401 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11594): Terminated: ok {rc=0} 02:00:28.305463 bus /sierra_3: Setting Powered False 02:00:29.403921 bus /sierra_3: Setting Powered False 02:00:30.517817 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 02:00:31.778421 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:00:31.788467 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 02:00:31.847381 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 02:00:31.880093 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 02:00:31.931593 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 02:00:31.990010 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 02:00:32.022184 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 02:00:32.556772 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 02:00:32.563213 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:00:32.574875 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 02:00:32.610044 tst handover.py: using LAC 25212 02:00:32.730246 tst handover.py: using RAC 222 02:00:32.851366 tst handover.py: using CellId 25212 02:00:32.970036 tst handover.py: using BVCI 25213 02:00:33.083351 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 02:00:33.127255 tst handover.py: using LAC 25213 02:00:33.246241 tst handover.py: using RAC 223 02:00:33.364371 tst handover.py: using CellId 25213 02:00:33.482535 tst handover.py: using BVCI 25214 02:00:33.593459 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:00:33.604500 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:00:33.615509 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:00:33.626687 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:00:33.637783 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:00:33.648994 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 02:00:33.769810 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 02:00:33.890153 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:00:34.372005 run create_hlr_db(pid=11600): Launched 02:00:34.507441 bus /sierra_2: Setting Powered False 02:00:35.572383 run create_hlr_db(pid=11600): Terminated: ok {rc=0} 02:00:36.000736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11602): Launched 02:00:36.332298 run osmo-hlr_10.42.42.2(pid=11603): Launched 02:00:36.458615 run osmo-stp_10.42.42.5: Starting osmo-stp 02:00:36.998711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11605): Launched 02:00:37.329692 run osmo-stp_10.42.42.5(pid=11606): Launched 02:00:37.455379 run osmo-msc_10.42.42.6: Starting osmo-msc 02:00:38.021499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11608): Launched 02:00:38.353713 run osmo-msc_10.42.42.6(pid=11609): Launched 02:00:38.539667 run osmo-stp_10.42.42.5(pid=11606): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11606)] 02:00:38.679190 run osmo-stp_10.42.42.5(pid=11606): stdout: | (launched: 2022-12-10_02:00:37.268609) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:00:38.818725 run osmo-stp_10.42.42.5(pid=11606): stderr: | 20221210020037466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020037466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020037466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020037467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020037467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020037467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020037467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:00:38.956903 run osmo-stp_10.42.42.5(pid=11606): stdout: | (launched: 2022-12-10_02:00:37.268609) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:00:39.087691 run osmo-stp_10.42.42.5(pid=11606): stderr: | 20221210020037466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020037466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020037466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020037467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020037467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020037467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020037467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:00:39.244286 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11606): Process ended prematurely: osmo-stp_10.42.42.5(pid=11606) [trial-2367↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11606)] [trial-2367↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 02:00:39.253343 tst handover.py:18: Test FAILED (6.7 sec) 02:00:39.280826 run osmo-hlr_10.42.42.2(pid=11603): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11603)] 02:00:39.330746 run osmo-hlr_10.42.42.2(pid=11603): stdout: | (launched: 2022-12-10_02:00:36.271666) 02:00:39.382497 run osmo-hlr_10.42.42.2(pid=11603): stderr: | 20221210020036473 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210020036473 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210020036473 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210020036473 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210020036473 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210020036473 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210020036485 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210020036494 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210020036494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210020036494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:00:39.454381 run osmo-msc_10.42.42.6(pid=11609): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11609)] 02:00:39.504405 run osmo-msc_10.42.42.6(pid=11609): stdout: | (launched: 2022-12-10_02:00:38.292768) 02:00:39.556171 run osmo-msc_10.42.42.6(pid=11609): stderr: | 20221210020038616 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210020038616 DLGLOBAL DEBUG validating counter group 0x7f9ec647ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210020038616 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210020038616 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210020038616 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210020038616 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210020038620 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210020038620 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210020038620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210020038621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:00:39.608183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11602): Terminating (SIGTERM) 02:00:39.650132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11605): Terminating (SIGTERM) 02:00:39.692289 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11608): Terminating (SIGTERM) 02:00:39.734460 --- ParallelTerminationStrategy: PID 11602 died... 02:00:39.754593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11602): Terminated: ok {rc=0} 02:00:39.800881 --- ParallelTerminationStrategy: PID 11605 died... 02:00:39.820656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11605): Terminated: ok {rc=0} 02:00:39.867359 --- ParallelTerminationStrategy: PID 11608 died... 02:00:39.887052 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11608): Terminated: ok {rc=0} 02:00:39.975941 bus /sierra_3: Setting Powered False 02:00:41.077138 bus /sierra_3: Setting Powered False 02:00:42.191932 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 02:00:43.447064 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:00:43.452625 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 02:00:43.503599 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 02:00:43.530849 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 02:00:43.584113 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 02:00:43.635307 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 02:00:43.662648 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 02:00:44.215264 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 02:00:44.220567 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:00:44.232050 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 02:00:44.266634 tst handover.py: using LAC 25214 02:00:44.395771 tst handover.py: using RAC 224 02:00:44.526168 tst handover.py: using CellId 25214 02:00:44.648285 tst handover.py: using BVCI 25215 02:00:44.761597 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 02:00:44.811746 tst handover.py: using LAC 25215 02:00:44.933922 tst handover.py: using RAC 225 02:00:45.053763 tst handover.py: using CellId 25215 02:00:45.176350 tst handover.py: using BVCI 25216 02:00:45.289435 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:00:45.300527 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:00:45.311631 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:00:45.323163 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:00:45.334703 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:00:45.346140 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 02:00:45.462909 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 02:00:45.581582 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:00:46.065875 run create_hlr_db(pid=11614): Launched 02:00:46.262265 bus /sierra_2: Setting Powered False 02:00:47.327360 run create_hlr_db(pid=11614): Terminated: ok {rc=0} 02:00:47.756355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11616): Launched 02:00:48.087710 run osmo-hlr_10.42.42.2(pid=11617): Launched 02:00:48.214719 run osmo-stp_10.42.42.5: Starting osmo-stp 02:00:48.752271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11619): Launched 02:00:49.083037 run osmo-stp_10.42.42.5(pid=11620): Launched 02:00:49.209971 run osmo-msc_10.42.42.6: Starting osmo-msc 02:00:49.774558 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11622): Launched 02:00:50.105461 run osmo-msc_10.42.42.6(pid=11623): Launched 02:00:50.289702 run osmo-stp_10.42.42.5(pid=11620): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11620)] 02:00:50.429674 run osmo-stp_10.42.42.5(pid=11620): stdout: | (launched: 2022-12-10_02:00:49.022839) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:00:50.568202 run osmo-stp_10.42.42.5(pid=11620): stderr: | 20221210020049217 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020049217 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020049218 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020049218 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020049218 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020049218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020049218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:00:50.705904 run osmo-stp_10.42.42.5(pid=11620): stdout: | (launched: 2022-12-10_02:00:49.022839) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:00:50.836643 run osmo-stp_10.42.42.5(pid=11620): stderr: | 20221210020049217 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020049217 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020049218 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020049218 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020049218 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020049218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020049218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:00:50.993553 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11620): Process ended prematurely: osmo-stp_10.42.42.5(pid=11620) [trial-2367↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11620)] [trial-2367↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 02:00:51.002737 tst handover.py:18: Test FAILED (6.8 sec) 02:00:51.030483 run osmo-hlr_10.42.42.2(pid=11617): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11617)] 02:00:51.080655 run osmo-hlr_10.42.42.2(pid=11617): stdout: | (launched: 2022-12-10_02:00:48.027334) 02:00:51.132649 run osmo-hlr_10.42.42.2(pid=11617): stderr: | 20221210020048227 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210020048227 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210020048227 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210020048227 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210020048227 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210020048227 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210020048240 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210020048248 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210020048248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210020048248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:00:51.205330 run osmo-msc_10.42.42.6(pid=11623): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11623)] 02:00:51.255693 run osmo-msc_10.42.42.6(pid=11623): stdout: | (launched: 2022-12-10_02:00:50.044685) 02:00:51.307429 run osmo-msc_10.42.42.6(pid=11623): stderr: | 20221210020050368 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210020050368 DLGLOBAL DEBUG validating counter group 0x7f9296c45c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210020050368 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210020050368 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210020050368 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210020050369 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210020050371 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210020050371 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210020050371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210020050371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:00:51.359511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11616): Terminating (SIGTERM) 02:00:51.401215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11619): Terminating (SIGTERM) 02:00:51.442960 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11622): Terminating (SIGTERM) 02:00:51.484908 --- ParallelTerminationStrategy: PID 11616 died... 02:00:51.504649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11616): Terminated: ok {rc=0} 02:00:51.551065 --- ParallelTerminationStrategy: PID 11619 died... 02:00:51.570745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11619): Terminated: ok {rc=0} 02:00:51.616694 --- ParallelTerminationStrategy: PID 11622 died... 02:00:51.636405 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11622): Terminated: ok {rc=0} 02:00:51.724891 bus /sierra_3: Setting Powered False 02:00:52.824179 bus /sierra_3: Setting Powered False 02:00:53.940812 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 02:00:55.204391 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:00:55.210167 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 02:00:55.248101 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 02:00:55.275398 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 02:00:55.334596 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 02:00:55.372299 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 02:00:55.399164 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 02:00:55.945058 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 02:00:55.950504 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:00:55.961862 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 02:00:55.996146 tst handover.py: using LAC 25216 02:00:56.123362 tst handover.py: using RAC 226 02:00:56.252902 tst handover.py: using CellId 25216 02:00:56.380198 tst handover.py: using BVCI 25217 02:00:56.499452 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 02:00:56.534250 tst handover.py: using LAC 25217 02:00:56.661717 tst handover.py: using RAC 227 02:00:56.788147 tst handover.py: using CellId 25217 02:00:56.916254 tst handover.py: using BVCI 25218 02:00:57.035075 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:00:57.046377 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:00:57.057511 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:00:57.068521 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:00:57.079621 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:00:57.090841 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 02:00:57.205785 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 02:00:57.327272 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:00:57.807906 run create_hlr_db(pid=11628): Launched 02:00:57.942184 bus /sierra_2: Setting Powered False 02:00:59.006900 run create_hlr_db(pid=11628): Terminated: ok {rc=0} 02:00:59.416401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11630): Launched 02:00:59.725726 run osmo-hlr_10.42.42.2(pid=11631): Launched 02:00:59.843602 run osmo-stp_10.42.42.5: Starting osmo-stp 02:01:00.347599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11633): Launched 02:01:00.654948 run osmo-stp_10.42.42.5(pid=11634): Launched 02:01:00.775401 run osmo-msc_10.42.42.6: Starting osmo-msc 02:01:01.329416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11636): Launched 02:01:01.652283 run osmo-msc_10.42.42.6(pid=11637): Launched 02:01:01.847738 run osmo-stp_10.42.42.5(pid=11634): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11634)] 02:01:02.125984 run osmo-stp_10.42.42.5(pid=11634): stdout: | (launched: 2022-12-10_02:01:00.598347) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:01:02.394030 run osmo-stp_10.42.42.5(pid=11634): stderr: | 20221210020100771 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020100771 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020100771 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020100772 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020100772 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020100772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020100772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:01:02.559884 run osmo-stp_10.42.42.5(pid=11634): stdout: | (launched: 2022-12-10_02:01:00.598347) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:01:02.690678 run osmo-stp_10.42.42.5(pid=11634): stderr: | 20221210020100771 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020100771 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020100771 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020100772 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020100772 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020100772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020100772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:01:02.846686 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11634): Process ended prematurely: osmo-stp_10.42.42.5(pid=11634) [trial-2367↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11634)] [trial-2367↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 02:01:02.855788 tst handover.py:18: Test FAILED (6.9 sec) 02:01:02.884239 run osmo-hlr_10.42.42.2(pid=11631): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11631)] 02:01:02.935011 run osmo-hlr_10.42.42.2(pid=11631): stdout: | (launched: 2022-12-10_02:00:59.668034) 02:01:02.987617 run osmo-hlr_10.42.42.2(pid=11631): stderr: | 20221210020059848 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210020059848 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210020059848 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210020059848 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210020059848 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210020059848 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210020059860 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210020059869 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210020059869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210020059869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:01:03.060803 run osmo-msc_10.42.42.6(pid=11637): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11637)] 02:01:03.111472 run osmo-msc_10.42.42.6(pid=11637): stdout: | (launched: 2022-12-10_02:01:01.593229) 02:01:03.163731 run osmo-msc_10.42.42.6(pid=11637): stderr: | 20221210020102173 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210020102174 DLGLOBAL DEBUG validating counter group 0x7f2c32758c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210020102174 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210020102174 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210020102174 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210020102174 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210020102176 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210020102176 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210020102177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210020102177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:01:03.216395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11630): Terminating (SIGTERM) 02:01:03.258419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11633): Terminating (SIGTERM) 02:01:03.300442 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11636): Terminating (SIGTERM) 02:01:03.342843 --- ParallelTerminationStrategy: PID 11630 died... 02:01:03.363273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11630): Terminated: ok {rc=0} 02:01:03.410163 --- ParallelTerminationStrategy: PID 11633 died... 02:01:03.430062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11633): Terminated: ok {rc=0} 02:01:03.476522 --- ParallelTerminationStrategy: PID 11636 died... 02:01:03.496393 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11636): Terminated: ok {rc=0} 02:01:03.584499 bus /sierra_3: Setting Powered False 02:01:04.683342 bus /sierra_3: Setting Powered False 02:01:05.797869 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 02:01:07.044847 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:01:07.051119 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 02:01:07.101620 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 02:01:07.128777 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 02:01:07.180298 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 02:01:07.230690 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 02:01:07.257862 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 02:01:07.810844 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 02:01:07.816268 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:01:07.827632 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 02:01:07.862140 tst handover.py: using LAC 25218 02:01:07.989293 tst handover.py: using RAC 228 02:01:08.117052 tst handover.py: using CellId 25218 02:01:08.243908 tst handover.py: using BVCI 25219 02:01:08.364070 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 02:01:08.412792 tst handover.py: using LAC 25219 02:01:08.540788 tst handover.py: using RAC 229 02:01:08.667706 tst handover.py: using CellId 25219 02:01:08.786213 tst handover.py: using BVCI 25220 02:01:08.897600 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:01:08.908456 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:01:08.919237 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:01:08.930362 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:01:08.941885 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:01:08.952900 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 02:01:09.072089 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 02:01:09.187482 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:01:09.638798 run create_hlr_db(pid=11642): Launched 02:01:09.758676 bus /sierra_2: Setting Powered False 02:01:10.819671 run create_hlr_db(pid=11642): Terminated: ok {rc=0} 02:01:11.240918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11644): Launched 02:01:11.572197 run osmo-hlr_10.42.42.2(pid=11645): Launched 02:01:11.700742 run osmo-stp_10.42.42.5: Starting osmo-stp 02:01:12.242893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11647): Launched 02:01:12.573684 run osmo-stp_10.42.42.5(pid=11648): Launched 02:01:12.701125 run osmo-msc_10.42.42.6: Starting osmo-msc 02:01:13.268918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11650): Launched 02:01:13.598144 run osmo-msc_10.42.42.6(pid=11651): Launched 02:01:13.781286 run osmo-stp_10.42.42.5(pid=11648): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11648)] 02:01:13.919991 run osmo-stp_10.42.42.5(pid=11648): stdout: | (launched: 2022-12-10_02:01:12.513140) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:01:14.058324 run osmo-stp_10.42.42.5(pid=11648): stderr: | 20221210020112709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020112710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020112710 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020112710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020112711 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020112711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020112711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:01:14.195209 run osmo-stp_10.42.42.5(pid=11648): stdout: | (launched: 2022-12-10_02:01:12.513140) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:01:14.325476 run osmo-stp_10.42.42.5(pid=11648): stderr: | 20221210020112709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020112710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020112710 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020112710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020112711 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020112711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020112711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:01:14.481181 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11648): Process ended prematurely: osmo-stp_10.42.42.5(pid=11648) [trial-2367↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11648)] [trial-2367↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 02:01:14.490156 tst handover.py:18: Test FAILED (6.7 sec) 02:01:14.518054 run osmo-hlr_10.42.42.2(pid=11645): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11645)] 02:01:14.568526 run osmo-hlr_10.42.42.2(pid=11645): stdout: | (launched: 2022-12-10_02:01:11.511702) 02:01:14.621155 run osmo-hlr_10.42.42.2(pid=11645): stderr: | 20221210020111714 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210020111714 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210020111714 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210020111714 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210020111714 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210020111714 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210020111728 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210020111738 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210020111738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210020111738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:01:14.693749 run osmo-msc_10.42.42.6(pid=11651): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11651)] 02:01:14.744205 run osmo-msc_10.42.42.6(pid=11651): stdout: | (launched: 2022-12-10_02:01:13.537052) 02:01:14.796458 run osmo-msc_10.42.42.6(pid=11651): stderr: | 20221210020113863 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210020113863 DLGLOBAL DEBUG validating counter group 0x7fbe616f9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210020113863 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210020113863 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210020113863 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210020113863 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210020113865 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210020113865 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210020113866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210020113866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:01:14.848913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11644): Terminating (SIGTERM) 02:01:14.891274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11647): Terminating (SIGTERM) 02:01:14.933410 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11650): Terminating (SIGTERM) 02:01:14.975524 --- ParallelTerminationStrategy: PID 11644 died... 02:01:14.995040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11644): Terminated: ok {rc=0} 02:01:15.041356 --- ParallelTerminationStrategy: PID 11647 died... 02:01:15.060819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11647): Terminated: ok {rc=0} 02:01:15.106715 --- ParallelTerminationStrategy: PID 11650 died... 02:01:15.126237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11650): Terminated: ok {rc=0} 02:01:15.213331 bus /sierra_3: Setting Powered False 02:01:16.309161 bus /sierra_3: Setting Powered False 02:01:17.421925 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 02:01:18.684092 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:01:18.690251 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 02:01:18.741627 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 02:01:18.768597 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 02:01:18.822622 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 02:01:18.874473 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 02:01:18.902444 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 02:01:19.448894 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 02:01:19.454598 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:01:19.466009 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:01:19.501989 tst handover.py: using LAC 25220 02:01:19.633567 tst handover.py: using RAC 230 02:01:19.762528 tst handover.py: using CellId 25220 02:01:19.892567 tst handover.py: using BVCI 25221 02:01:20.012356 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:01:20.061742 tst handover.py: using LAC 25221 02:01:20.191287 tst handover.py: using RAC 231 02:01:20.321862 tst handover.py: using CellId 25221 02:01:20.450267 tst handover.py: using BVCI 25222 02:01:20.570156 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:01:20.581663 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:01:20.592777 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:01:20.604061 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:01:20.615285 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:01:20.626507 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:01:20.746646 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:01:20.866067 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:01:21.348747 run create_hlr_db(pid=11656): Launched 02:01:21.482864 bus /sierra_2: Setting Powered False 02:01:22.547760 run create_hlr_db(pid=11656): Terminated: ok {rc=0} 02:01:22.976567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11658): Launched 02:01:23.307793 run osmo-hlr_10.42.42.2(pid=11659): Launched 02:01:23.435686 run osmo-stp_10.42.42.5: Starting osmo-stp 02:01:23.972396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11661): Launched 02:01:24.302825 run osmo-stp_10.42.42.5(pid=11662): Launched 02:01:24.430384 run osmo-msc_10.42.42.6: Starting osmo-msc 02:01:24.997821 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11664): Launched 02:01:25.330915 run osmo-msc_10.42.42.6(pid=11665): Launched 02:01:25.516599 run osmo-stp_10.42.42.5(pid=11662): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11662)] 02:01:25.655631 run osmo-stp_10.42.42.5(pid=11662): stdout: | (launched: 2022-12-10_02:01:24.241863) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:01:25.794148 run osmo-stp_10.42.42.5(pid=11662): stderr: | 20221210020124437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020124437 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020124437 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020124438 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020124438 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020124438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020124438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:01:25.932088 run osmo-stp_10.42.42.5(pid=11662): stdout: | (launched: 2022-12-10_02:01:24.241863) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:01:26.062624 run osmo-stp_10.42.42.5(pid=11662): stderr: | 20221210020124437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020124437 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020124437 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020124438 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020124438 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020124438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020124438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:01:26.218768 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11662): Process ended prematurely: osmo-stp_10.42.42.5(pid=11662) [trial-2367↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11662)] [trial-2367↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 02:01:26.227719 tst handover.py:18: Test FAILED (6.8 sec) 02:01:26.255103 run osmo-hlr_10.42.42.2(pid=11659): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11659)] 02:01:26.304937 run osmo-hlr_10.42.42.2(pid=11659): stdout: | (launched: 2022-12-10_02:01:23.247371) 02:01:26.356578 run osmo-hlr_10.42.42.2(pid=11659): stderr: | 20221210020123448 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210020123448 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210020123448 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210020123448 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210020123448 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210020123448 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210020123466 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210020123474 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210020123475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210020123475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:01:26.428319 run osmo-msc_10.42.42.6(pid=11665): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11665)] 02:01:26.478027 run osmo-msc_10.42.42.6(pid=11665): stdout: | (launched: 2022-12-10_02:01:25.269762) 02:01:26.529490 run osmo-msc_10.42.42.6(pid=11665): stderr: | 20221210020125596 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210020125596 DLGLOBAL DEBUG validating counter group 0x7f680ef21c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210020125596 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210020125596 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210020125597 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210020125597 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210020125598 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210020125599 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210020125599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210020125599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:01:26.581506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11658): Terminating (SIGTERM) 02:01:26.623440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11661): Terminating (SIGTERM) 02:01:26.665289 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11664): Terminating (SIGTERM) 02:01:26.707510 --- ParallelTerminationStrategy: PID 11658 died... 02:01:26.727234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11658): Terminated: ok {rc=0} 02:01:26.773527 --- ParallelTerminationStrategy: PID 11661 died... 02:01:26.793188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11661): Terminated: ok {rc=0} 02:01:26.839223 --- ParallelTerminationStrategy: PID 11664 died... 02:01:26.858857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11664): Terminated: ok {rc=0} 02:01:26.946453 bus /sierra_3: Setting Powered False 02:01:28.045032 bus /sierra_3: Setting Powered False 02:01:29.162815 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 02:01:30.418148 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:01:30.423588 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 02:01:30.484057 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 02:01:30.511245 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 02:01:30.565416 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 02:01:30.624786 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 02:01:30.652083 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 02:01:31.233823 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 02:01:31.241381 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:01:31.256060 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 02:01:31.318404 tst handover.py: using LAC 25222 02:01:31.440305 tst handover.py: using RAC 232 02:01:31.576541 tst handover.py: using CellId 25222 02:01:31.743400 tst handover.py: using BVCI 25223 02:01:31.858020 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 02:01:31.905368 tst handover.py: using LAC 25223 02:01:32.037846 tst handover.py: using RAC 233 02:01:32.168874 tst handover.py: using CellId 25223 02:01:32.298937 tst handover.py: using BVCI 25224 02:01:32.419726 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:01:32.431499 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:01:32.443082 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:01:32.454879 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:01:32.467401 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:01:32.479335 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 02:01:32.595309 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 02:01:32.711719 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:01:33.162077 run create_hlr_db(pid=11670): Launched 02:01:33.282596 bus /sierra_2: Setting Powered False 02:01:34.343449 run create_hlr_db(pid=11670): Terminated: ok {rc=0} 02:01:34.743834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11672): Launched 02:01:35.052287 run osmo-hlr_10.42.42.2(pid=11673): Launched 02:01:35.170564 run osmo-stp_10.42.42.5: Starting osmo-stp 02:01:35.671240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11675): Launched 02:01:35.979660 run osmo-stp_10.42.42.5(pid=11676): Launched 02:01:36.097556 run osmo-msc_10.42.42.6: Starting osmo-msc 02:01:36.625456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11678): Launched 02:01:36.934767 run osmo-msc_10.42.42.6(pid=11679): Launched 02:01:37.106808 run osmo-stp_10.42.42.5(pid=11676): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11676)] 02:01:37.237497 run osmo-stp_10.42.42.5(pid=11676): stdout: | (launched: 2022-12-10_02:01:35.922680) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:01:37.366935 run osmo-stp_10.42.42.5(pid=11676): stderr: | 20221210020136095 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020136096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020136096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020136096 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020136097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020136097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020136097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:01:37.494128 run osmo-stp_10.42.42.5(pid=11676): stdout: | (launched: 2022-12-10_02:01:35.922680) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:01:37.615527 run osmo-stp_10.42.42.5(pid=11676): stderr: | 20221210020136095 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020136096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020136096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020136096 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020136097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020136097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020136097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:01:37.760774 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11676): Process ended prematurely: osmo-stp_10.42.42.5(pid=11676) [trial-2367↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11676)] [trial-2367↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 02:01:37.769322 tst handover.py:18: Test FAILED (6.5 sec) 02:01:37.795829 run osmo-hlr_10.42.42.2(pid=11673): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11673)] 02:01:37.843454 run osmo-hlr_10.42.42.2(pid=11673): stdout: | (launched: 2022-12-10_02:01:34.995284) 02:01:37.892478 run osmo-hlr_10.42.42.2(pid=11673): stderr: | 20221210020135172 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210020135172 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210020135172 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210020135172 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210020135172 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210020135173 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210020135190 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210020135200 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210020135201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210020135201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:01:37.960880 run osmo-msc_10.42.42.6(pid=11679): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11679)] 02:01:38.008353 run osmo-msc_10.42.42.6(pid=11679): stdout: | (launched: 2022-12-10_02:01:36.877630) 02:01:38.057469 run osmo-msc_10.42.42.6(pid=11679): stderr: | 20221210020137151 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210020137151 DLGLOBAL DEBUG validating counter group 0x7fd9e12aac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210020137152 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210020137152 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210020137152 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210020137152 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210020137154 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210020137154 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210020137154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210020137154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:01:38.108161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11672): Terminating (SIGTERM) 02:01:38.147907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11675): Terminating (SIGTERM) 02:01:38.187454 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11678): Terminating (SIGTERM) 02:01:38.227325 --- ParallelTerminationStrategy: PID 11672 died... 02:01:38.246364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11672): Terminated: ok {rc=0} 02:01:38.290490 --- ParallelTerminationStrategy: PID 11675 died... 02:01:38.308936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11675): Terminated: ok {rc=0} 02:01:38.353833 --- ParallelTerminationStrategy: PID 11678 died... 02:01:38.372496 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11678): Terminated: ok {rc=0} 02:01:38.457105 bus /sierra_3: Setting Powered False 02:01:39.555661 bus /sierra_3: Setting Powered False 02:01:40.671628 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 02:01:41.943987 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:01:41.949950 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 02:01:42.014759 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 02:01:42.041943 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 02:01:42.096271 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 02:01:42.162399 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 02:01:42.189708 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 02:01:42.739440 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 02:01:42.744896 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:01:42.756600 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 02:01:42.805646 tst handover.py: using LAC 25224 02:01:42.935846 tst handover.py: using RAC 234 02:01:43.066370 tst handover.py: using CellId 25224 02:01:43.189346 tst handover.py: using BVCI 25225 02:01:43.300773 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 02:01:43.351080 tst handover.py: using LAC 25225 02:01:43.478914 tst handover.py: using RAC 235 02:01:43.608515 tst handover.py: using CellId 25225 02:01:43.735797 tst handover.py: using BVCI 25226 02:01:43.854693 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:01:43.866366 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:01:43.877852 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:01:43.889992 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:01:43.901432 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:01:43.912544 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 02:01:44.027995 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 02:01:44.144898 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:01:44.594661 run create_hlr_db(pid=11684): Launched 02:01:44.714584 bus /sierra_2: Setting Powered False 02:01:45.775302 run create_hlr_db(pid=11684): Terminated: ok {rc=0} 02:01:46.225732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11686): Launched 02:01:46.551712 run osmo-hlr_10.42.42.2(pid=11687): Launched 02:01:46.821117 run osmo-stp_10.42.42.5: Starting osmo-stp 02:01:47.449619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11689): Launched 02:01:47.758655 run osmo-stp_10.42.42.5(pid=11690): Launched 02:01:47.875668 run osmo-msc_10.42.42.6: Starting osmo-msc 02:01:48.404142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11692): Launched 02:01:48.712179 run osmo-msc_10.42.42.6(pid=11693): Launched 02:01:48.884553 run osmo-stp_10.42.42.5(pid=11690): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11690)] 02:01:49.014303 run osmo-stp_10.42.42.5(pid=11690): stdout: | (launched: 2022-12-10_02:01:47.701720) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:01:49.143743 run osmo-stp_10.42.42.5(pid=11690): stderr: | 20221210020147874 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020147874 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020147874 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020147875 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020147875 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020147875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020147875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:01:49.270898 run osmo-stp_10.42.42.5(pid=11690): stdout: | (launched: 2022-12-10_02:01:47.701720) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:01:49.392046 run osmo-stp_10.42.42.5(pid=11690): stderr: | 20221210020147874 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020147874 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020147874 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020147875 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020147875 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020147875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020147875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:01:49.536939 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11690): Process ended prematurely: osmo-stp_10.42.42.5(pid=11690) [trial-2367↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11690)] [trial-2367↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 02:01:49.545286 tst handover.py:18: Test FAILED (6.8 sec) 02:01:49.571929 run osmo-hlr_10.42.42.2(pid=11687): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11687)] 02:01:49.619912 run osmo-hlr_10.42.42.2(pid=11687): stdout: | (launched: 2022-12-10_02:01:46.493541) 02:01:49.669556 run osmo-hlr_10.42.42.2(pid=11687): stderr: | 20221210020146773 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210020146773 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210020146773 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210020146773 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210020146773 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210020146773 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210020146791 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210020146807 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210020146808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210020146808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:01:49.738231 run osmo-msc_10.42.42.6(pid=11693): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11693)] 02:01:49.786005 run osmo-msc_10.42.42.6(pid=11693): stdout: | (launched: 2022-12-10_02:01:48.655209) 02:01:49.835634 run osmo-msc_10.42.42.6(pid=11693): stderr: | 20221210020148928 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210020148928 DLGLOBAL DEBUG validating counter group 0x7f4f87c26c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210020148928 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210020148929 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210020148929 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210020148929 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210020148931 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210020148931 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210020148931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210020148931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:01:49.885606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11686): Terminating (SIGTERM) 02:01:49.925630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11689): Terminating (SIGTERM) 02:01:49.965663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11692): Terminating (SIGTERM) 02:01:50.005851 --- ParallelTerminationStrategy: PID 11686 died... 02:01:50.024921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11686): Terminated: ok {rc=0} 02:01:50.069534 --- ParallelTerminationStrategy: PID 11689 died... 02:01:50.088126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11689): Terminated: ok {rc=0} 02:01:50.132368 --- ParallelTerminationStrategy: PID 11692 died... 02:01:50.151153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11692): Terminated: ok {rc=0} 02:01:50.238088 bus /sierra_3: Setting Powered False 02:01:51.337416 bus /sierra_3: Setting Powered False 02:01:52.452473 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 02:01:53.726984 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:01:53.732313 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 02:01:53.783279 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 02:01:53.809792 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 02:01:53.863132 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 02:01:53.913637 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 02:01:53.940022 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 02:01:54.491782 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 02:01:54.497285 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:01:54.510339 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 02:01:54.558200 tst handover.py: using LAC 25226 02:01:54.687720 tst handover.py: using RAC 236 02:01:54.814981 tst handover.py: using CellId 25226 02:01:54.944061 tst handover.py: using BVCI 25227 02:01:55.063208 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 02:01:55.098479 tst handover.py: using LAC 25227 02:01:55.225286 tst handover.py: using RAC 237 02:01:55.351505 tst handover.py: using CellId 25227 02:01:55.480195 tst handover.py: using BVCI 25228 02:01:55.598444 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:01:55.609909 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:01:55.621014 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:01:55.632103 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:01:55.643338 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:01:55.654414 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 02:01:55.769513 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 02:01:55.884180 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:01:56.331765 run create_hlr_db(pid=11698): Launched 02:01:56.450794 bus /sierra_2: Setting Powered False 02:01:57.511699 run create_hlr_db(pid=11698): Terminated: ok {rc=0} 02:01:57.911887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11700): Launched 02:01:58.218510 run osmo-hlr_10.42.42.2(pid=11701): Launched 02:01:58.336027 run osmo-stp_10.42.42.5: Starting osmo-stp 02:01:58.834570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11703): Launched 02:01:59.141642 run osmo-stp_10.42.42.5(pid=11704): Launched 02:01:59.259596 run osmo-msc_10.42.42.6: Starting osmo-msc 02:01:59.789296 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11706): Launched 02:02:00.096839 run osmo-msc_10.42.42.6(pid=11707): Launched 02:02:00.268548 run osmo-stp_10.42.42.5(pid=11704): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11704)] 02:02:00.398889 run osmo-stp_10.42.42.5(pid=11704): stdout: | (launched: 2022-12-10_02:01:59.084488) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:02:00.528171 run osmo-stp_10.42.42.5(pid=11704): stderr: | 20221210020159257 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020159257 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020159257 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020159258 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020159258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020159258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020159258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:02:00.655216 run osmo-stp_10.42.42.5(pid=11704): stdout: | (launched: 2022-12-10_02:01:59.084488) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:02:00.775863 run osmo-stp_10.42.42.5(pid=11704): stderr: | 20221210020159257 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020159257 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020159257 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020159258 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020159258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020159258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020159258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:02:00.923062 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11704): Process ended prematurely: osmo-stp_10.42.42.5(pid=11704) [trial-2367↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11704)] [trial-2367↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 02:02:00.931950 tst handover.py:18: Test FAILED (6.4 sec) 02:02:00.959847 run osmo-hlr_10.42.42.2(pid=11701): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11701)] 02:02:01.009676 run osmo-hlr_10.42.42.2(pid=11701): stdout: | (launched: 2022-12-10_02:01:58.161734) 02:02:01.060714 run osmo-hlr_10.42.42.2(pid=11701): stderr: | 20221210020158341 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210020158341 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210020158341 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210020158341 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210020158341 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210020158341 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210020158357 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210020158367 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210020158367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210020158367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:02:01.132170 run osmo-msc_10.42.42.6(pid=11707): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11707)] 02:02:01.181794 run osmo-msc_10.42.42.6(pid=11707): stdout: | (launched: 2022-12-10_02:02:00.040043) 02:02:01.233167 run osmo-msc_10.42.42.6(pid=11707): stderr: | 20221210020200312 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210020200312 DLGLOBAL DEBUG validating counter group 0x7f839288ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210020200312 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210020200312 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210020200312 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210020200313 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210020200316 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210020200317 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210020200317 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210020200317 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:02:01.285426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11700): Terminating (SIGTERM) 02:02:01.327291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11703): Terminating (SIGTERM) 02:02:01.369467 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11706): Terminating (SIGTERM) 02:02:01.411789 --- ParallelTerminationStrategy: PID 11700 died... 02:02:01.431475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11700): Terminated: ok {rc=0} 02:02:01.478578 --- ParallelTerminationStrategy: PID 11703 died... 02:02:01.498286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11703): Terminated: ok {rc=0} 02:02:01.545567 --- ParallelTerminationStrategy: PID 11706 died... 02:02:01.565075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11706): Terminated: ok {rc=0} 02:02:01.654887 bus /sierra_3: Setting Powered False 02:02:02.754879 bus /sierra_3: Setting Powered False 02:02:03.870247 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 02:02:05.123901 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:02:05.129301 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 02:02:05.191752 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 02:02:05.218470 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 02:02:05.271322 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 02:02:05.334720 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 02:02:05.361013 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 02:02:05.908268 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 02:02:05.913614 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:02:05.924436 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 02:02:05.972023 tst handover.py: using LAC 25228 02:02:06.102313 tst handover.py: using RAC 238 02:02:06.231912 tst handover.py: using CellId 25228 02:02:06.361461 tst handover.py: using BVCI 25229 02:02:06.482228 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 02:02:06.531864 tst handover.py: using LAC 25229 02:02:06.662876 tst handover.py: using RAC 239 02:02:06.783355 tst handover.py: using CellId 25229 02:02:06.904129 tst handover.py: using BVCI 25230 02:02:07.015025 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:02:07.025902 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:02:07.036522 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:02:07.047561 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:02:07.058650 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:02:07.069511 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 02:02:07.189758 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 02:02:07.309573 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:02:07.790207 run create_hlr_db(pid=11713): Launched 02:02:07.924430 bus /sierra_2: Setting Powered False 02:02:08.990177 run create_hlr_db(pid=11713): Terminated: ok {rc=0} 02:02:09.417423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11715): Launched 02:02:09.749051 run osmo-hlr_10.42.42.2(pid=11716): Launched 02:02:09.874786 run osmo-stp_10.42.42.5: Starting osmo-stp 02:02:10.415944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11718): Launched 02:02:10.746435 run osmo-stp_10.42.42.5(pid=11719): Launched 02:02:10.873820 run osmo-msc_10.42.42.6: Starting osmo-msc 02:02:11.442695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11721): Launched 02:02:11.771412 run osmo-msc_10.42.42.6(pid=11722): Launched 02:02:11.958001 run osmo-stp_10.42.42.5(pid=11719): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11719)] 02:02:12.096089 run osmo-stp_10.42.42.5(pid=11719): stdout: | (launched: 2022-12-10_02:02:10.685665) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:02:12.234546 run osmo-stp_10.42.42.5(pid=11719): stderr: | 20221210020210882 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020210882 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020210883 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020210883 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020210883 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020210883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020210883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:02:12.371619 run osmo-stp_10.42.42.5(pid=11719): stdout: | (launched: 2022-12-10_02:02:10.685665) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:02:12.501362 run osmo-stp_10.42.42.5(pid=11719): stderr: | 20221210020210882 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020210882 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020210883 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020210883 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020210883 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020210883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020210883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:02:12.657247 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11719): Process ended prematurely: osmo-stp_10.42.42.5(pid=11719) [trial-2367↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11719)] [trial-2367↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 02:02:12.666245 tst handover.py:18: Test FAILED (6.7 sec) 02:02:12.693873 run osmo-hlr_10.42.42.2(pid=11716): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11716)] 02:02:12.743854 run osmo-hlr_10.42.42.2(pid=11716): stdout: | (launched: 2022-12-10_02:02:09.687895) 02:02:12.795673 run osmo-hlr_10.42.42.2(pid=11716): stderr: | 20221210020209890 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210020209890 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210020209890 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210020209890 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210020209890 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210020209890 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210020209902 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210020209911 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210020209911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210020209911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:02:12.867654 run osmo-msc_10.42.42.6(pid=11722): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11722)] 02:02:12.917661 run osmo-msc_10.42.42.6(pid=11722): stdout: | (launched: 2022-12-10_02:02:11.710962) 02:02:12.968875 run osmo-msc_10.42.42.6(pid=11722): stderr: | 20221210020212033 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210020212033 DLGLOBAL DEBUG validating counter group 0x7f644fef7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210020212033 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210020212034 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210020212034 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210020212034 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210020212035 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210020212036 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210020212036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210020212036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:02:13.021068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11715): Terminating (SIGTERM) 02:02:13.062338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11718): Terminating (SIGTERM) 02:02:13.103473 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11721): Terminating (SIGTERM) 02:02:13.144821 --- ParallelTerminationStrategy: PID 11715 died... 02:02:13.164722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11715): Terminated: ok {rc=0} 02:02:13.210329 --- ParallelTerminationStrategy: PID 11718 died... 02:02:13.229561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11718): Terminated: ok {rc=0} 02:02:13.274668 --- ParallelTerminationStrategy: PID 11721 died... 02:02:13.293963 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11721): Terminated: ok {rc=0} 02:02:13.381553 bus /sierra_3: Setting Powered False 02:02:14.479600 bus /sierra_3: Setting Powered False 02:02:15.596732 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 02:02:16.913061 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:02:16.926831 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 02:02:17.001934 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 02:02:17.030840 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 02:02:17.084130 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 02:02:17.151981 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 02:02:17.183823 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 02:02:17.728424 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 02:02:17.734823 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:02:17.746620 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:02:17.800270 tst handover.py: using LAC 25230 02:02:17.928759 tst handover.py: using RAC 240 02:02:18.058947 tst handover.py: using CellId 25230 02:02:18.180055 tst handover.py: using BVCI 25231 02:02:18.291834 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:02:18.338611 tst handover.py: using LAC 25231 02:02:18.459853 tst handover.py: using RAC 241 02:02:18.579069 tst handover.py: using CellId 25231 02:02:18.698083 tst handover.py: using BVCI 25232 02:02:18.809346 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:02:18.820250 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:02:18.831245 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:02:18.842813 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:02:18.854451 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:02:18.866006 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:02:18.987866 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:02:19.103331 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:02:19.553495 run create_hlr_db(pid=11728): Launched 02:02:19.671628 bus /sierra_2: Setting Powered False 02:02:20.731578 run create_hlr_db(pid=11728): Terminated: ok {rc=0} 02:02:21.132552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11730): Launched 02:02:21.439630 run osmo-hlr_10.42.42.2(pid=11731): Launched 02:02:21.557228 run osmo-stp_10.42.42.5: Starting osmo-stp 02:02:22.076070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11733): Launched 02:02:22.382884 run osmo-stp_10.42.42.5(pid=11734): Launched 02:02:22.501158 run osmo-msc_10.42.42.6: Starting osmo-msc 02:02:23.028929 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11736): Launched 02:02:23.335763 run osmo-msc_10.42.42.6(pid=11737): Launched 02:02:23.508144 run osmo-stp_10.42.42.5(pid=11734): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11734)] 02:02:23.639182 run osmo-stp_10.42.42.5(pid=11734): stdout: | (launched: 2022-12-10_02:02:22.326006) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:02:23.769129 run osmo-stp_10.42.42.5(pid=11734): stderr: | 20221210020222498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020222498 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020222498 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020222498 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020222499 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020222499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020222499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:02:23.896541 run osmo-stp_10.42.42.5(pid=11734): stdout: | (launched: 2022-12-10_02:02:22.326006) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:02:24.018229 run osmo-stp_10.42.42.5(pid=11734): stderr: | 20221210020222498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020222498 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020222498 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020222498 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020222499 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020222499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020222499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:02:24.163938 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11734): Process ended prematurely: osmo-stp_10.42.42.5(pid=11734) [trial-2367↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11734)] [trial-2367↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 02:02:24.172248 tst handover.py:18: Test FAILED (6.4 sec) 02:02:24.199252 run osmo-hlr_10.42.42.2(pid=11731): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11731)] 02:02:24.247091 run osmo-hlr_10.42.42.2(pid=11731): stdout: | (launched: 2022-12-10_02:02:21.382659) 02:02:24.296328 run osmo-hlr_10.42.42.2(pid=11731): stderr: | 20221210020221563 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210020221563 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210020221563 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210020221563 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210020221563 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210020221563 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210020221575 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210020221583 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210020221583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210020221584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:02:24.365087 run osmo-msc_10.42.42.6(pid=11737): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11737)] 02:02:24.412505 run osmo-msc_10.42.42.6(pid=11737): stdout: | (launched: 2022-12-10_02:02:23.278818) 02:02:24.461379 run osmo-msc_10.42.42.6(pid=11737): stderr: | 20221210020223553 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210020223554 DLGLOBAL DEBUG validating counter group 0x7f4c54481c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210020223554 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210020223554 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210020223554 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210020223554 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210020223556 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210020223556 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210020223556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210020223556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:02:24.510683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11730): Terminating (SIGTERM) 02:02:24.550108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11733): Terminating (SIGTERM) 02:02:24.590050 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11736): Terminating (SIGTERM) 02:02:24.629956 --- ParallelTerminationStrategy: PID 11730 died... 02:02:24.649076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11730): Terminated: ok {rc=0} 02:02:24.693282 --- ParallelTerminationStrategy: PID 11733 died... 02:02:24.711801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11733): Terminated: ok {rc=0} 02:02:24.756032 --- ParallelTerminationStrategy: PID 11736 died... 02:02:24.774645 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11736): Terminated: ok {rc=0} 02:02:24.858063 bus /sierra_3: Setting Powered False 02:02:25.955377 bus /sierra_3: Setting Powered False 02:02:27.072028 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 02:02:28.349796 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:02:28.356023 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 02:02:28.416772 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 02:02:28.444094 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 02:02:28.497459 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 02:02:28.559097 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 02:02:28.586473 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 02:02:29.140721 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 02:02:29.146315 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:02:29.157987 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 02:02:29.202790 tst handover.py: using LAC 25232 02:02:29.332415 tst handover.py: using RAC 242 02:02:29.461065 tst handover.py: using CellId 25232 02:02:29.588825 tst handover.py: using BVCI 25233 02:02:29.707923 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 02:02:29.758707 tst handover.py: using LAC 25233 02:02:29.888182 tst handover.py: using RAC 243 02:02:30.017096 tst handover.py: using CellId 25233 02:02:30.144482 tst handover.py: using BVCI 25234 02:02:30.263892 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:02:30.275541 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:02:30.287080 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:02:30.299093 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:02:30.310612 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:02:30.322637 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 02:02:30.439054 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 02:02:30.553308 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:02:31.051884 run create_hlr_db(pid=11742): Launched 02:02:31.208843 bus /sierra_2: Setting Powered False 02:02:32.282921 run create_hlr_db(pid=11742): Terminated: ok {rc=0} 02:02:32.693512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11744): Launched 02:02:33.002922 run osmo-hlr_10.42.42.2(pid=11745): Launched 02:02:33.122437 run osmo-stp_10.42.42.5: Starting osmo-stp 02:02:33.627863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11747): Launched 02:02:33.934807 run osmo-stp_10.42.42.5(pid=11748): Launched 02:02:34.052663 run osmo-msc_10.42.42.6: Starting osmo-msc 02:02:34.583851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11750): Launched 02:02:34.892500 run osmo-msc_10.42.42.6(pid=11751): Launched 02:02:35.064480 run osmo-stp_10.42.42.5(pid=11748): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11748)] 02:02:35.195597 run osmo-stp_10.42.42.5(pid=11748): stdout: | (launched: 2022-12-10_02:02:33.877879) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:02:35.325527 run osmo-stp_10.42.42.5(pid=11748): stderr: | 20221210020234048 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020234048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020234048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020234049 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020234049 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020234049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020234049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:02:35.452606 run osmo-stp_10.42.42.5(pid=11748): stdout: | (launched: 2022-12-10_02:02:33.877879) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:02:35.573979 run osmo-stp_10.42.42.5(pid=11748): stderr: | 20221210020234048 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020234048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020234048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020234049 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020234049 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020234049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020234049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:02:35.719852 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11748): Process ended prematurely: osmo-stp_10.42.42.5(pid=11748) [trial-2367↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11748)] [trial-2367↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 02:02:35.728287 tst handover.py:18: Test FAILED (6.6 sec) 02:02:35.754743 run osmo-hlr_10.42.42.2(pid=11745): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11745)] 02:02:35.802471 run osmo-hlr_10.42.42.2(pid=11745): stdout: | (launched: 2022-12-10_02:02:32.945637) 02:02:35.851647 run osmo-hlr_10.42.42.2(pid=11745): stderr: | 20221210020233123 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210020233123 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210020233123 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210020233123 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210020233123 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210020233123 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210020233135 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210020233143 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210020233143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210020233143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:02:35.923759 run osmo-msc_10.42.42.6(pid=11751): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11751)] 02:02:35.971669 run osmo-msc_10.42.42.6(pid=11751): stdout: | (launched: 2022-12-10_02:02:34.834638) 02:02:36.021143 run osmo-msc_10.42.42.6(pid=11751): stderr: | 20221210020235109 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210020235109 DLGLOBAL DEBUG validating counter group 0x7f0386093c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210020235109 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210020235109 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210020235109 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210020235110 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210020235111 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210020235112 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210020235112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210020235112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:02:36.071275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11744): Terminating (SIGTERM) 02:02:36.111406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11747): Terminating (SIGTERM) 02:02:36.151385 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11750): Terminating (SIGTERM) 02:02:36.191706 --- ParallelTerminationStrategy: PID 11744 died... 02:02:36.210888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11744): Terminated: ok {rc=0} 02:02:36.255340 --- ParallelTerminationStrategy: PID 11747 died... 02:02:36.274119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11747): Terminated: ok {rc=0} 02:02:36.318399 --- ParallelTerminationStrategy: PID 11750 died... 02:02:36.337067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11750): Terminated: ok {rc=0} 02:02:36.423632 bus /sierra_3: Setting Powered False 02:02:37.523988 bus /sierra_3: Setting Powered False 02:02:38.640563 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 02:02:39.919031 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:02:39.925416 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 02:02:39.973169 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 02:02:40.000446 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 02:02:40.054820 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 02:02:40.102881 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 02:02:40.130117 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 02:02:40.681952 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 02:02:40.688484 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:02:40.699681 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 02:02:40.743433 tst handover.py: using LAC 25234 02:02:40.864909 tst handover.py: using RAC 244 02:02:40.993478 tst handover.py: using CellId 25234 02:02:41.114335 tst handover.py: using BVCI 25235 02:02:41.227535 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 02:02:41.262096 tst handover.py: using LAC 25235 02:02:41.383454 tst handover.py: using RAC 245 02:02:41.503436 tst handover.py: using CellId 25235 02:02:41.625940 tst handover.py: using BVCI 25236 02:02:41.737335 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:02:41.748319 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:02:41.759151 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:02:41.770853 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:02:41.782546 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:02:41.794053 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 02:02:41.915702 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 02:02:42.033513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:02:42.482279 run create_hlr_db(pid=11756): Launched 02:02:42.601570 bus /sierra_2: Setting Powered False 02:02:43.662241 run create_hlr_db(pid=11756): Terminated: ok {rc=0} 02:02:44.062367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11758): Launched 02:02:44.369980 run osmo-hlr_10.42.42.2(pid=11759): Launched 02:02:44.487215 run osmo-stp_10.42.42.5: Starting osmo-stp 02:02:45.006031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11761): Launched 02:02:45.313038 run osmo-stp_10.42.42.5(pid=11762): Launched 02:02:45.430887 run osmo-msc_10.42.42.6: Starting osmo-msc 02:02:45.999292 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11764): Launched 02:02:46.327735 run osmo-msc_10.42.42.6(pid=11765): Launched 02:02:46.536866 run osmo-stp_10.42.42.5(pid=11762): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11762)] 02:02:46.779300 run osmo-stp_10.42.42.5(pid=11762): stdout: | (launched: 2022-12-10_02:02:45.255873) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:02:47.099834 run osmo-stp_10.42.42.5(pid=11762): stderr: | 20221210020245427 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020245427 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020245427 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020245428 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020245428 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020245428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020245429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:02:47.301290 run osmo-stp_10.42.42.5(pid=11762): stdout: | (launched: 2022-12-10_02:02:45.255873) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:02:47.426717 run osmo-stp_10.42.42.5(pid=11762): stderr: | 20221210020245427 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020245427 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020245427 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020245428 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020245428 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020245428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020245429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:02:47.576545 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11762): Process ended prematurely: osmo-stp_10.42.42.5(pid=11762) [trial-2367↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11762)] [trial-2367↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 02:02:47.585025 tst handover.py:18: Test FAILED (6.9 sec) 02:02:47.612824 run osmo-hlr_10.42.42.2(pid=11759): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11759)] 02:02:47.661315 run osmo-hlr_10.42.42.2(pid=11759): stdout: | (launched: 2022-12-10_02:02:44.313175) 02:02:47.711197 run osmo-hlr_10.42.42.2(pid=11759): stderr: | 20221210020244493 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210020244493 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210020244493 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210020244493 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210020244493 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210020244494 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210020244506 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210020244514 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210020244515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210020244515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:02:47.780372 run osmo-msc_10.42.42.6(pid=11765): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11765)] 02:02:47.828522 run osmo-msc_10.42.42.6(pid=11765): stdout: | (launched: 2022-12-10_02:02:46.269307) 02:02:47.878508 run osmo-msc_10.42.42.6(pid=11765): stderr: | 20221210020246904 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210020246904 DLGLOBAL DEBUG validating counter group 0x7f7a33fa4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210020246904 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210020246904 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210020246906 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210020246906 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210020246908 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210020246910 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210020246911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210020246911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:02:47.928915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11758): Terminating (SIGTERM) 02:02:47.969377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11761): Terminating (SIGTERM) 02:02:48.009775 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11764): Terminating (SIGTERM) 02:02:48.050582 --- ParallelTerminationStrategy: PID 11758 died... 02:02:48.069498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11758): Terminated: ok {rc=0} 02:02:48.114915 --- ParallelTerminationStrategy: PID 11761 died... 02:02:48.133463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11761): Terminated: ok {rc=0} 02:02:48.178728 --- ParallelTerminationStrategy: PID 11764 died... 02:02:48.197233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11764): Terminated: ok {rc=0} 02:02:48.283963 bus /sierra_3: Setting Powered False 02:02:49.380783 bus /sierra_3: Setting Powered False 02:02:50.494773 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 02:02:51.750764 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:02:51.756800 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 02:02:51.816898 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 02:02:51.844332 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 02:02:51.915403 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 02:02:51.975736 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 02:02:52.002347 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 02:02:52.544441 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 02:02:52.550082 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:02:52.561477 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 02:02:52.606161 tst handover.py: using LAC 25236 02:02:52.726264 tst handover.py: using RAC 246 02:02:52.845498 tst handover.py: using CellId 25236 02:02:52.976583 tst handover.py: using BVCI 25237 02:02:53.096233 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 02:02:53.144914 tst handover.py: using LAC 25237 02:02:53.270917 tst handover.py: using RAC 247 02:02:53.400636 tst handover.py: using CellId 25237 02:02:53.520641 tst handover.py: using BVCI 25238 02:02:53.631164 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:02:53.642447 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:02:53.653515 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:02:53.665032 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:02:53.676540 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:02:53.687968 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 02:02:53.808194 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 02:02:53.929419 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:02:54.409938 run create_hlr_db(pid=11771): Launched 02:02:54.545446 bus /sierra_2: Setting Powered False 02:02:55.610469 run create_hlr_db(pid=11771): Terminated: ok {rc=0} 02:02:56.021319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11773): Launched 02:02:56.328893 run osmo-hlr_10.42.42.2(pid=11774): Launched 02:02:56.447288 run osmo-stp_10.42.42.5: Starting osmo-stp 02:02:56.962620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11776): Launched 02:02:57.270899 run osmo-stp_10.42.42.5(pid=11777): Launched 02:02:57.390870 run osmo-msc_10.42.42.6: Starting osmo-msc 02:02:57.931498 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11779): Launched 02:02:58.240345 run osmo-msc_10.42.42.6(pid=11780): Launched 02:02:58.413390 run osmo-stp_10.42.42.5(pid=11777): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11777)] 02:02:58.545055 run osmo-stp_10.42.42.5(pid=11777): stdout: | (launched: 2022-12-10_02:02:57.213632) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:02:58.674532 run osmo-stp_10.42.42.5(pid=11777): stderr: | 20221210020257385 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020257385 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020257385 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020257385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020257387 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020257388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020257388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:02:58.801651 run osmo-stp_10.42.42.5(pid=11777): stdout: | (launched: 2022-12-10_02:02:57.213632) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:02:58.923204 run osmo-stp_10.42.42.5(pid=11777): stderr: | 20221210020257385 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020257385 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020257385 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020257385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020257387 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020257388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020257388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:02:59.068570 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11777): Process ended prematurely: osmo-stp_10.42.42.5(pid=11777) [trial-2367↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11777)] [trial-2367↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 02:02:59.077161 tst handover.py:18: Test FAILED (6.5 sec) 02:02:59.104042 run osmo-hlr_10.42.42.2(pid=11774): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11774)] 02:02:59.151537 run osmo-hlr_10.42.42.2(pid=11774): stdout: | (launched: 2022-12-10_02:02:56.271755) 02:02:59.200526 run osmo-hlr_10.42.42.2(pid=11774): stderr: | 20221210020256448 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210020256448 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210020256448 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210020256448 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210020256448 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210020256448 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210020256464 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210020256475 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210020256475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210020256475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:02:59.268809 run osmo-msc_10.42.42.6(pid=11780): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11780)] 02:02:59.315942 run osmo-msc_10.42.42.6(pid=11780): stdout: | (launched: 2022-12-10_02:02:58.183120) 02:02:59.365063 run osmo-msc_10.42.42.6(pid=11780): stderr: | 20221210020258454 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210020258455 DLGLOBAL DEBUG validating counter group 0x7ff429b9dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210020258455 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210020258455 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210020258455 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210020258455 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210020258457 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210020258457 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210020258457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210020258458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:02:59.414425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11773): Terminating (SIGTERM) 02:02:59.453749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11776): Terminating (SIGTERM) 02:02:59.493169 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11779): Terminating (SIGTERM) 02:02:59.532730 --- ParallelTerminationStrategy: PID 11773 died... 02:02:59.551810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11773): Terminated: ok {rc=0} 02:02:59.595477 --- ParallelTerminationStrategy: PID 11776 died... 02:02:59.613880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11776): Terminated: ok {rc=0} 02:02:59.657744 --- ParallelTerminationStrategy: PID 11779 died... 02:02:59.676310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11779): Terminated: ok {rc=0} 02:02:59.759320 bus /sierra_3: Setting Powered False 02:03:00.856380 bus /sierra_3: Setting Powered False 02:03:01.997663 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 02:03:03.275339 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:03:03.282202 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 02:03:03.341611 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 02:03:03.368876 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 02:03:03.423461 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 02:03:03.482555 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 02:03:03.509616 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 02:03:04.063933 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 02:03:04.069476 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:03:04.080871 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:03:04.125455 tst handover.py: using LAC 25238 02:03:04.256632 tst handover.py: using RAC 248 02:03:04.386401 tst handover.py: using CellId 25238 02:03:04.516109 tst handover.py: using BVCI 25239 02:03:04.637128 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:03:04.686382 tst handover.py: using LAC 25239 02:03:04.819489 tst handover.py: using RAC 249 02:03:04.951460 tst handover.py: using CellId 25239 02:03:05.079619 tst handover.py: using BVCI 25240 02:03:05.199210 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:03:05.210780 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:03:05.222209 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:03:05.233676 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:03:05.245118 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:03:05.256409 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:03:05.370103 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:03:05.484175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:03:05.933993 run create_hlr_db(pid=11786): Launched 02:03:06.071765 bus /sierra_2: Setting Powered False 02:03:07.137079 run create_hlr_db(pid=11786): Terminated: ok {rc=0} 02:03:07.564317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11788): Launched 02:03:07.893279 run osmo-hlr_10.42.42.2(pid=11789): Launched 02:03:08.019781 run osmo-stp_10.42.42.5: Starting osmo-stp 02:03:08.555870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11791): Launched 02:03:08.885634 run osmo-stp_10.42.42.5(pid=11792): Launched 02:03:09.013895 run osmo-msc_10.42.42.6: Starting osmo-msc 02:03:09.581326 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11794): Launched 02:03:09.909643 run osmo-msc_10.42.42.6(pid=11795): Launched 02:03:10.095513 run osmo-stp_10.42.42.5(pid=11792): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11792)] 02:03:10.233643 run osmo-stp_10.42.42.5(pid=11792): stdout: | (launched: 2022-12-10_02:03:08.824941) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:03:10.371823 run osmo-stp_10.42.42.5(pid=11792): stderr: | 20221210020309018 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020309018 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020309018 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020309018 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020309019 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020309019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020309019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:03:10.509165 run osmo-stp_10.42.42.5(pid=11792): stdout: | (launched: 2022-12-10_02:03:08.824941) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:03:10.639551 run osmo-stp_10.42.42.5(pid=11792): stderr: | 20221210020309018 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020309018 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020309018 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020309018 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020309019 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020309019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020309019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:03:10.795448 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11792): Process ended prematurely: osmo-stp_10.42.42.5(pid=11792) [trial-2367↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11792)] [trial-2367↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 02:03:10.804351 tst handover.py:18: Test FAILED (6.7 sec) 02:03:10.832013 run osmo-hlr_10.42.42.2(pid=11789): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11789)] 02:03:10.881624 run osmo-hlr_10.42.42.2(pid=11789): stdout: | (launched: 2022-12-10_02:03:07.832706) 02:03:10.933501 run osmo-hlr_10.42.42.2(pid=11789): stderr: | 20221210020308032 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210020308032 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210020308032 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210020308032 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210020308032 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210020308032 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210020308045 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210020308053 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210020308053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210020308053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:03:11.005548 run osmo-msc_10.42.42.6(pid=11795): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11795)] 02:03:11.055293 run osmo-msc_10.42.42.6(pid=11795): stdout: | (launched: 2022-12-10_02:03:09.849121) 02:03:11.106710 run osmo-msc_10.42.42.6(pid=11795): stderr: | 20221210020310173 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210020310173 DLGLOBAL DEBUG validating counter group 0x7f7250f50c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210020310173 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210020310173 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210020310173 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210020310174 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210020310175 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210020310176 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210020310176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210020310176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:03:11.158305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11788): Terminating (SIGTERM) 02:03:11.199396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11791): Terminating (SIGTERM) 02:03:11.240652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11794): Terminating (SIGTERM) 02:03:11.282240 --- ParallelTerminationStrategy: PID 11788 died... 02:03:11.301703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11788): Terminated: ok {rc=0} 02:03:11.347299 --- ParallelTerminationStrategy: PID 11791 died... 02:03:11.366630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11791): Terminated: ok {rc=0} 02:03:11.411871 --- ParallelTerminationStrategy: PID 11794 died... 02:03:11.431182 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11794): Terminated: ok {rc=0} 02:03:11.518787 bus /sierra_3: Setting Powered False 02:03:12.616856 bus /sierra_3: Setting Powered False 02:03:13.733821 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 02:03:15.002584 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:03:15.007670 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 02:03:15.058805 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 02:03:15.085449 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 02:03:15.138413 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 02:03:15.189825 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 02:03:15.216529 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 02:03:15.765366 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 02:03:15.770589 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:03:15.781632 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 02:03:15.830124 tst handover.py: using LAC 25240 02:03:15.968415 tst handover.py: using RAC 250 02:03:16.093698 tst handover.py: using CellId 25240 02:03:16.217148 tst handover.py: using BVCI 25241 02:03:16.335357 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 02:03:16.371761 tst handover.py: using LAC 25241 02:03:16.497664 tst handover.py: using RAC 251 02:03:16.626385 tst handover.py: using CellId 25241 02:03:16.757218 tst handover.py: using BVCI 25242 02:03:16.872888 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:03:16.884932 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:03:16.896887 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:03:16.910644 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:03:16.923577 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:03:16.935352 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 02:03:17.055709 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 02:03:17.180692 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:03:17.655366 run create_hlr_db(pid=11800): Launched 02:03:17.774162 bus /sierra_2: Setting Powered False 02:03:18.835375 run create_hlr_db(pid=11800): Terminated: ok {rc=0} 02:03:19.255384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11802): Launched 02:03:19.587917 run osmo-hlr_10.42.42.2(pid=11803): Launched 02:03:19.714069 run osmo-stp_10.42.42.5: Starting osmo-stp 02:03:20.257857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11805): Launched 02:03:20.587941 run osmo-stp_10.42.42.5(pid=11806): Launched 02:03:20.715767 run osmo-msc_10.42.42.6: Starting osmo-msc 02:03:21.282946 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11808): Launched 02:03:21.615226 run osmo-msc_10.42.42.6(pid=11809): Launched 02:03:21.801812 run osmo-stp_10.42.42.5(pid=11806): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11806)] 02:03:21.939837 run osmo-stp_10.42.42.5(pid=11806): stdout: | (launched: 2022-12-10_02:03:20.527118) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:03:22.077673 run osmo-stp_10.42.42.5(pid=11806): stderr: | 20221210020320721 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020320721 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020320721 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020320721 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020320722 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020320722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020320722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:03:22.214170 run osmo-stp_10.42.42.5(pid=11806): stdout: | (launched: 2022-12-10_02:03:20.527118) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:03:22.344084 run osmo-stp_10.42.42.5(pid=11806): stderr: | 20221210020320721 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020320721 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020320721 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020320721 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020320722 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020320722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020320722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:03:22.499624 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11806): Process ended prematurely: osmo-stp_10.42.42.5(pid=11806) [trial-2367↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11806)] [trial-2367↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 02:03:22.508675 tst handover.py:18: Test FAILED (6.7 sec) 02:03:22.536439 run osmo-hlr_10.42.42.2(pid=11803): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11803)] 02:03:22.586873 run osmo-hlr_10.42.42.2(pid=11803): stdout: | (launched: 2022-12-10_02:03:19.526514) 02:03:22.638607 run osmo-hlr_10.42.42.2(pid=11803): stderr: | 20221210020319727 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210020319727 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210020319727 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210020319727 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210020319727 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210020319727 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210020319743 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210020319753 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210020319754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210020319754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:03:22.710386 run osmo-msc_10.42.42.6(pid=11809): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11809)] 02:03:22.760001 run osmo-msc_10.42.42.6(pid=11809): stdout: | (launched: 2022-12-10_02:03:21.554289) 02:03:22.811266 run osmo-msc_10.42.42.6(pid=11809): stderr: | 20221210020321880 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210020321881 DLGLOBAL DEBUG validating counter group 0x7fc4ce34dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210020321881 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210020321881 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210020321881 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210020321881 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210020321883 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210020321883 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210020321884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210020321884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:03:22.863012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11802): Terminating (SIGTERM) 02:03:22.904402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11805): Terminating (SIGTERM) 02:03:22.946421 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11808): Terminating (SIGTERM) 02:03:22.988679 --- ParallelTerminationStrategy: PID 11802 died... 02:03:23.008470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11802): Terminated: ok {rc=0} 02:03:23.054738 --- ParallelTerminationStrategy: PID 11805 died... 02:03:23.074466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11805): Terminated: ok {rc=0} 02:03:23.120391 --- ParallelTerminationStrategy: PID 11808 died... 02:03:23.140035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11808): Terminated: ok {rc=0} 02:03:23.227340 bus /sierra_3: Setting Powered False 02:03:24.327165 bus /sierra_3: Setting Powered False 02:03:25.444744 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 02:03:26.708308 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:03:26.713892 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 02:03:26.777397 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 02:03:26.803926 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 02:03:26.857643 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 02:03:26.924339 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 02:03:26.950709 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 02:03:27.497034 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 02:03:27.502168 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:03:27.513112 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 02:03:27.561898 tst handover.py: using LAC 25242 02:03:27.690358 tst handover.py: using RAC 252 02:03:27.819879 tst handover.py: using CellId 25242 02:03:27.941061 tst handover.py: using BVCI 25243 02:03:28.053660 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 02:03:28.101690 tst handover.py: using LAC 25243 02:03:28.229652 tst handover.py: using RAC 253 02:03:28.358659 tst handover.py: using CellId 25243 02:03:28.488285 tst handover.py: using BVCI 25244 02:03:28.607226 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:03:28.619131 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:03:28.630439 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:03:28.641817 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:03:28.653053 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:03:28.664182 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 02:03:28.780702 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 02:03:28.899903 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:03:29.380335 run create_hlr_db(pid=11814): Launched 02:03:29.515071 bus /sierra_2: Setting Powered False 02:03:30.579578 run create_hlr_db(pid=11814): Terminated: ok {rc=0} 02:03:31.001691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11816): Launched 02:03:31.328145 run osmo-hlr_10.42.42.2(pid=11817): Launched 02:03:31.581340 run osmo-stp_10.42.42.5: Starting osmo-stp 02:03:32.129678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11819): Launched 02:03:32.448385 run osmo-stp_10.42.42.5(pid=11820): Launched 02:03:32.568922 run osmo-msc_10.42.42.6: Starting osmo-msc 02:03:33.099837 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11822): Launched 02:03:33.407539 run osmo-msc_10.42.42.6(pid=11823): Launched 02:03:33.580160 run osmo-stp_10.42.42.5(pid=11820): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11820)] 02:03:33.710241 run osmo-stp_10.42.42.5(pid=11820): stdout: | (launched: 2022-12-10_02:03:32.391169) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:03:33.839029 run osmo-stp_10.42.42.5(pid=11820): stderr: | 20221210020332561 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020332561 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020332561 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020332562 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020332562 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020332562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020332562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:03:33.965782 run osmo-stp_10.42.42.5(pid=11820): stdout: | (launched: 2022-12-10_02:03:32.391169) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:03:34.086860 run osmo-stp_10.42.42.5(pid=11820): stderr: | 20221210020332561 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020332561 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020332561 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020332562 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020332562 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020332562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020332562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:03:34.231936 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11820): Process ended prematurely: osmo-stp_10.42.42.5(pid=11820) [trial-2367↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11820)] [trial-2367↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 02:03:34.240250 tst handover.py:18: Test FAILED (6.7 sec) 02:03:34.267028 run osmo-hlr_10.42.42.2(pid=11817): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11817)] 02:03:34.314388 run osmo-hlr_10.42.42.2(pid=11817): stdout: | (launched: 2022-12-10_02:03:31.269912) 02:03:34.363458 run osmo-hlr_10.42.42.2(pid=11817): stderr: | 20221210020331538 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210020331538 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210020331538 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210020331538 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210020331538 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210020331538 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210020331555 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210020331563 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210020331564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210020331564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:03:34.431853 run osmo-msc_10.42.42.6(pid=11823): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11823)] 02:03:34.479130 run osmo-msc_10.42.42.6(pid=11823): stdout: | (launched: 2022-12-10_02:03:33.350485) 02:03:34.527842 run osmo-msc_10.42.42.6(pid=11823): stderr: | 20221210020333624 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210020333624 DLGLOBAL DEBUG validating counter group 0x7f403894ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210020333625 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210020333625 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210020333625 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210020333625 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210020333627 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210020333627 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210020333627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210020333627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:03:34.577018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11816): Terminating (SIGTERM) 02:03:34.616134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11819): Terminating (SIGTERM) 02:03:34.655314 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11822): Terminating (SIGTERM) 02:03:34.694655 --- ParallelTerminationStrategy: PID 11816 died... 02:03:34.713589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11816): Terminated: ok {rc=0} 02:03:34.757152 --- ParallelTerminationStrategy: PID 11819 died... 02:03:34.775548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11819): Terminated: ok {rc=0} 02:03:34.819048 --- ParallelTerminationStrategy: PID 11822 died... 02:03:34.837438 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11822): Terminated: ok {rc=0} 02:03:34.920781 bus /sierra_3: Setting Powered False 02:03:36.018202 bus /sierra_3: Setting Powered False 02:03:37.134743 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 02:03:38.412460 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:03:38.418300 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 02:03:38.482584 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 02:03:38.509951 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 02:03:38.564325 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 02:03:38.629385 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 02:03:38.656567 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 02:03:39.211659 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 02:03:39.218642 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:03:39.230660 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:03:39.287525 tst handover.py: using LAC 25244 02:03:39.415480 tst handover.py: using RAC 254 02:03:39.542272 tst handover.py: using CellId 25244 02:03:39.668366 tst handover.py: using BVCI 25245 02:03:39.787269 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:03:39.834607 tst handover.py: using LAC 25245 02:03:39.963623 tst handover.py: using RAC 255 02:03:40.090044 tst handover.py: using CellId 25245 02:03:40.215801 tst handover.py: using BVCI 25246 02:03:40.336260 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:03:40.347834 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:03:40.359080 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:03:40.370409 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:03:40.381870 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:03:40.393276 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:03:40.508601 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:03:40.630427 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:03:41.112172 run create_hlr_db(pid=11828): Launched 02:03:41.247572 bus /sierra_2: Setting Powered False 02:03:42.307985 run create_hlr_db(pid=11828): Terminated: ok {rc=0} 02:03:42.727137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11830): Launched 02:03:43.056759 run osmo-hlr_10.42.42.2(pid=11831): Launched 02:03:43.184608 run osmo-stp_10.42.42.5: Starting osmo-stp 02:03:43.720697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11833): Launched 02:03:44.052111 run osmo-stp_10.42.42.5(pid=11834): Launched 02:03:44.177601 run osmo-msc_10.42.42.6: Starting osmo-msc 02:03:44.741640 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11836): Launched 02:03:45.074706 run osmo-msc_10.42.42.6(pid=11837): Launched 02:03:45.259669 run osmo-stp_10.42.42.5(pid=11834): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11834)] 02:03:45.400151 run osmo-stp_10.42.42.5(pid=11834): stdout: | (launched: 2022-12-10_02:03:43.991363) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:03:45.539324 run osmo-stp_10.42.42.5(pid=11834): stderr: | 20221210020344186 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020344186 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020344186 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020344186 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020344187 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020344187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020344187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:03:45.676646 run osmo-stp_10.42.42.5(pid=11834): stdout: | (launched: 2022-12-10_02:03:43.991363) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:03:45.807453 run osmo-stp_10.42.42.5(pid=11834): stderr: | 20221210020344186 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020344186 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020344186 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020344186 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020344187 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020344187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020344187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:03:45.970903 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11834): Process ended prematurely: osmo-stp_10.42.42.5(pid=11834) [trial-2367↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11834)] [trial-2367↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 02:03:45.980294 tst handover.py:18: Test FAILED (6.8 sec) 02:03:46.010106 run osmo-hlr_10.42.42.2(pid=11831): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11831)] 02:03:46.060511 run osmo-hlr_10.42.42.2(pid=11831): stdout: | (launched: 2022-12-10_02:03:42.996052) 02:03:46.114293 run osmo-hlr_10.42.42.2(pid=11831): stderr: | 20221210020343199 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210020343199 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210020343199 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210020343199 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210020343199 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210020343199 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210020343211 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210020343220 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210020343220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210020343220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:03:46.186379 run osmo-msc_10.42.42.6(pid=11837): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11837)] 02:03:46.236456 run osmo-msc_10.42.42.6(pid=11837): stdout: | (launched: 2022-12-10_02:03:45.013708) 02:03:46.289132 run osmo-msc_10.42.42.6(pid=11837): stderr: | 20221210020345337 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210020345338 DLGLOBAL DEBUG validating counter group 0x7f7a5b28ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210020345338 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210020345338 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210020345338 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210020345338 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210020345340 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210020345340 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210020345340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210020345340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:03:46.341136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11830): Terminating (SIGTERM) 02:03:46.385879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11833): Terminating (SIGTERM) 02:03:46.430113 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11836): Terminating (SIGTERM) 02:03:46.475834 --- ParallelTerminationStrategy: PID 11830 died... 02:03:46.495640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11830): Terminated: ok {rc=0} 02:03:46.544585 --- ParallelTerminationStrategy: PID 11833 died... 02:03:46.564688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11833): Terminated: ok {rc=0} 02:03:46.613406 --- ParallelTerminationStrategy: PID 11836 died... 02:03:46.633041 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11836): Terminated: ok {rc=0} 02:03:46.721451 bus /sierra_3: Setting Powered False 02:03:47.821371 bus /sierra_3: Setting Powered False 02:03:48.935670 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 02:03:50.216759 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:03:50.222323 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 02:03:50.274494 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 02:03:50.301888 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 02:03:50.353864 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 02:03:50.405709 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 02:03:50.433009 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 02:03:50.989069 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 02:03:50.994579 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:03:51.005892 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 02:03:51.041130 tst handover.py: using LAC 25246 02:03:51.166440 tst handover.py: using RAC 1 02:03:51.292085 tst handover.py: using CellId 25246 02:03:51.410162 tst handover.py: using BVCI 25247 02:03:51.522861 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 02:03:51.569618 tst handover.py: using LAC 25247 02:03:51.689369 tst handover.py: using RAC 2 02:03:51.808455 tst handover.py: using CellId 25247 02:03:51.926187 tst handover.py: using BVCI 25248 02:03:52.037100 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:03:52.047796 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:03:52.058509 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:03:52.069451 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:03:52.080219 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:03:52.090999 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 02:03:52.204894 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 02:03:52.323142 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:03:52.803744 run create_hlr_db(pid=11842): Launched 02:03:52.938701 bus /sierra_2: Setting Powered False 02:03:54.003493 run create_hlr_db(pid=11842): Terminated: ok {rc=0} 02:03:54.414882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11844): Launched 02:03:54.723485 run osmo-hlr_10.42.42.2(pid=11845): Launched 02:03:54.841730 run osmo-stp_10.42.42.5: Starting osmo-stp 02:03:55.358511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11847): Launched 02:03:55.666089 run osmo-stp_10.42.42.5(pid=11848): Launched 02:03:55.787336 run osmo-msc_10.42.42.6: Starting osmo-msc 02:03:56.329980 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11850): Launched 02:03:56.642307 run osmo-msc_10.42.42.6(pid=11851): Launched 02:03:56.815808 run osmo-stp_10.42.42.5(pid=11848): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11848)] 02:03:56.945898 run osmo-stp_10.42.42.5(pid=11848): stdout: | (launched: 2022-12-10_02:03:55.608660) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:03:57.074796 run osmo-stp_10.42.42.5(pid=11848): stderr: | 20221210020355784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020355784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020355784 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020355785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020355786 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020355786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020355786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:03:57.201890 run osmo-stp_10.42.42.5(pid=11848): stdout: | (launched: 2022-12-10_02:03:55.608660) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:03:57.323653 run osmo-stp_10.42.42.5(pid=11848): stderr: | 20221210020355784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020355784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020355784 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020355785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020355786 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020355786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020355786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:03:57.469544 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11848): Process ended prematurely: osmo-stp_10.42.42.5(pid=11848) [trial-2367↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11848)] [trial-2367↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 02:03:57.477758 tst handover.py:18: Test FAILED (6.5 sec) 02:03:57.504536 run osmo-hlr_10.42.42.2(pid=11845): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11845)] 02:03:57.552129 run osmo-hlr_10.42.42.2(pid=11845): stdout: | (launched: 2022-12-10_02:03:54.666444) 02:03:57.601465 run osmo-hlr_10.42.42.2(pid=11845): stderr: | 20221210020354845 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210020354845 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210020354845 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210020354845 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210020354845 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210020354845 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210020354857 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210020354866 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210020354866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210020354866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:03:57.670558 run osmo-msc_10.42.42.6(pid=11851): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11851)] 02:03:57.718098 run osmo-msc_10.42.42.6(pid=11851): stdout: | (launched: 2022-12-10_02:03:56.584223) 02:03:57.767284 run osmo-msc_10.42.42.6(pid=11851): stderr: | 20221210020356858 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210020356858 DLGLOBAL DEBUG validating counter group 0x7f7a6959fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210020356858 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210020356858 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210020356858 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210020356858 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210020356860 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210020356860 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210020356861 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210020356861 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:03:57.817270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11844): Terminating (SIGTERM) 02:03:57.856977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11847): Terminating (SIGTERM) 02:03:57.896563 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11850): Terminating (SIGTERM) 02:03:57.936604 --- ParallelTerminationStrategy: PID 11844 died... 02:03:57.955766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11844): Terminated: ok {rc=0} 02:03:58.000236 --- ParallelTerminationStrategy: PID 11847 died... 02:03:58.018911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11847): Terminated: ok {rc=0} 02:03:58.063120 --- ParallelTerminationStrategy: PID 11850 died... 02:03:58.081736 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11850): Terminated: ok {rc=0} 02:03:58.167747 bus /sierra_3: Setting Powered False 02:03:59.267268 bus /sierra_3: Setting Powered False 02:04:00.380362 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 02:04:01.647549 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:04:01.654126 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 02:04:01.710488 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 02:04:01.739290 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 02:04:01.795273 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 02:04:01.860539 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 02:04:01.896039 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 02:04:02.423905 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 02:04:02.429344 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:02.440565 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:04:02.476752 tst handover.py: using LAC 25248 02:04:02.605871 tst handover.py: using RAC 3 02:04:02.734363 tst handover.py: using CellId 25248 02:04:02.862103 tst handover.py: using BVCI 25249 02:04:02.981982 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:04:03.030759 tst handover.py: using LAC 25249 02:04:03.159101 tst handover.py: using RAC 4 02:04:03.288507 tst handover.py: using CellId 25249 02:04:03.417370 tst handover.py: using BVCI 25250 02:04:03.536701 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:03.547989 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:03.559157 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:03.570294 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:03.581547 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:03.592599 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:04:03.708125 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:04:03.827973 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:04:04.309571 run create_hlr_db(pid=11856): Launched 02:04:04.445112 bus /sierra_2: Setting Powered False 02:04:05.509994 run create_hlr_db(pid=11856): Terminated: ok {rc=0} 02:04:05.921687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11858): Launched 02:04:06.231340 run osmo-hlr_10.42.42.2(pid=11859): Launched 02:04:06.350986 run osmo-stp_10.42.42.5: Starting osmo-stp 02:04:06.852939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11861): Launched 02:04:07.161136 run osmo-stp_10.42.42.5(pid=11862): Launched 02:04:07.278909 run osmo-msc_10.42.42.6: Starting osmo-msc 02:04:07.808264 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11864): Launched 02:04:08.118524 run osmo-msc_10.42.42.6(pid=11865): Launched 02:04:08.292404 run osmo-stp_10.42.42.5(pid=11862): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11862)] 02:04:08.423264 run osmo-stp_10.42.42.5(pid=11862): stdout: | (launched: 2022-12-10_02:04:07.103665) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:04:08.552365 run osmo-stp_10.42.42.5(pid=11862): stderr: | 20221210020407275 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020407276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020407276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020407276 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020407278 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020407279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020407279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:04:08.679750 run osmo-stp_10.42.42.5(pid=11862): stdout: | (launched: 2022-12-10_02:04:07.103665) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:04:08.801339 run osmo-stp_10.42.42.5(pid=11862): stderr: | 20221210020407275 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020407276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020407276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020407276 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020407278 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020407279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020407279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:04:08.947176 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11862): Process ended prematurely: osmo-stp_10.42.42.5(pid=11862) [trial-2367↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11862)] [trial-2367↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 02:04:08.955440 tst handover.py:18: Test FAILED (6.5 sec) 02:04:08.982247 run osmo-hlr_10.42.42.2(pid=11859): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11859)] 02:04:09.030300 run osmo-hlr_10.42.42.2(pid=11859): stdout: | (launched: 2022-12-10_02:04:06.174248) 02:04:09.080049 run osmo-hlr_10.42.42.2(pid=11859): stderr: | 20221210020406353 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210020406353 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210020406353 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210020406353 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210020406353 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210020406353 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210020406373 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210020406383 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210020406383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210020406383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:04:09.149412 run osmo-msc_10.42.42.6(pid=11865): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11865)] 02:04:09.197518 run osmo-msc_10.42.42.6(pid=11865): stdout: | (launched: 2022-12-10_02:04:08.061245) 02:04:09.246920 run osmo-msc_10.42.42.6(pid=11865): stderr: | 20221210020408332 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210020408333 DLGLOBAL DEBUG validating counter group 0x7efdfd206c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210020408333 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210020408333 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210020408333 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210020408333 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210020408335 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210020408335 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210020408335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210020408335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:04:09.296902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11858): Terminating (SIGTERM) 02:04:09.336735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11861): Terminating (SIGTERM) 02:04:09.376846 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11864): Terminating (SIGTERM) 02:04:09.417133 --- ParallelTerminationStrategy: PID 11858 died... 02:04:09.436347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11858): Terminated: ok {rc=0} 02:04:09.480815 --- ParallelTerminationStrategy: PID 11861 died... 02:04:09.499545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11861): Terminated: ok {rc=0} 02:04:09.543809 --- ParallelTerminationStrategy: PID 11864 died... 02:04:09.562615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11864): Terminated: ok {rc=0} 02:04:09.648585 bus /sierra_3: Setting Powered False 02:04:10.752211 bus /sierra_3: Setting Powered False 02:04:11.869835 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2367 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 02:04:13.124776 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:04:13.130416 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 02:04:13.192269 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 02:04:13.219198 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 02:04:13.272597 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 02:04:13.334458 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 02:04:13.360859 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 02:04:13.909551 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2367 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 02:04:13.914745 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:13.925693 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:04:13.973756 tst handover.py: using LAC 25250 02:04:14.099166 tst handover.py: using RAC 5 02:04:14.218220 tst handover.py: using CellId 25250 02:04:14.338185 tst handover.py: using BVCI 25251 02:04:14.450399 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:04:14.496407 tst handover.py: using LAC 25251 02:04:14.616384 tst handover.py: using RAC 6 02:04:14.734696 tst handover.py: using CellId 25251 02:04:14.853020 tst handover.py: using BVCI 25252 02:04:14.965164 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:14.975976 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:14.986619 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:14.997597 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:15.008587 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:15.019536 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:04:15.133264 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:04:15.249553 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:04:15.698398 run create_hlr_db(pid=11870): Launched 02:04:15.816017 bus /sierra_2: Setting Powered False 02:04:16.879649 run create_hlr_db(pid=11870): Terminated: ok {rc=0} 02:04:17.315347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11872): Launched 02:04:17.645911 run osmo-hlr_10.42.42.2(pid=11873): Launched 02:04:17.772288 run osmo-stp_10.42.42.5: Starting osmo-stp 02:04:18.313738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11875): Launched 02:04:18.643552 run osmo-stp_10.42.42.5(pid=11876): Launched 02:04:18.770602 run osmo-msc_10.42.42.6: Starting osmo-msc 02:04:19.336895 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11878): Launched 02:04:19.667805 run osmo-msc_10.42.42.6(pid=11879): Launched 02:04:19.853254 run osmo-stp_10.42.42.5(pid=11876): ERR: Terminated: ERROR {rc=1} [trial-2367↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11876)] 02:04:19.991785 run osmo-stp_10.42.42.5(pid=11876): stdout: | (launched: 2022-12-10_02:04:18.583022) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:04:20.129924 run osmo-stp_10.42.42.5(pid=11876): stderr: | 20221210020418777 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020418777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020418778 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020418778 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020418778 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020418779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020418779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:04:20.266724 run osmo-stp_10.42.42.5(pid=11876): stdout: | (launched: 2022-12-10_02:04:18.583022) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:04:20.396566 run osmo-stp_10.42.42.5(pid=11876): stderr: | 20221210020418777 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210020418777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210020418778 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210020418778 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020418778 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020418779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020418779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:04:20.552357 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11876): Process ended prematurely: osmo-stp_10.42.42.5(pid=11876) [trial-2367↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11876)] [trial-2367↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 02:04:20.561518 tst handover.py:18: Test FAILED (6.6 sec) 02:04:20.589076 run osmo-hlr_10.42.42.2(pid=11873): ERR: Terminated: ERROR {rc=237} [trial-2367↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11873)] 02:04:20.639286 run osmo-hlr_10.42.42.2(pid=11873): stdout: | (launched: 2022-12-10_02:04:17.585460) 02:04:20.691124 run osmo-hlr_10.42.42.2(pid=11873): stderr: | 20221210020417789 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210020417789 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210020417789 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210020417789 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210020417789 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210020417789 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210020417802 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210020417810 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210020417810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210020417811 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:04:20.763674 run osmo-msc_10.42.42.6(pid=11879): ERR: Terminated: ERROR {rc=2} [trial-2367↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11879)] 02:04:20.813834 run osmo-msc_10.42.42.6(pid=11879): stdout: | (launched: 2022-12-10_02:04:19.607243) 02:04:20.865607 run osmo-msc_10.42.42.6(pid=11879): stderr: | 20221210020419931 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210020419931 DLGLOBAL DEBUG validating counter group 0x7ff258634c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210020419931 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210020419931 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210020419931 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210020419931 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210020419933 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210020419934 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210020419934 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210020419934 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:04:20.917830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11872): Terminating (SIGTERM) 02:04:20.960039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11875): Terminating (SIGTERM) 02:04:21.001790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11878): Terminating (SIGTERM) 02:04:21.044062 --- ParallelTerminationStrategy: PID 11872 died... 02:04:21.064231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11872): Terminated: ok {rc=0} 02:04:21.110612 --- ParallelTerminationStrategy: PID 11875 died... 02:04:21.130242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11875): Terminated: ok {rc=0} 02:04:21.176216 --- ParallelTerminationStrategy: PID 11878 died... 02:04:21.195914 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11878): Terminated: ok {rc=0} 02:04:21.283598 bus /sierra_3: Setting Powered False 02:04:22.383388 bus /sierra_3: Setting Powered False 02:04:23.498663 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2367 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 02:04:24.773178 tst trial-2367: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367/run.2022-12-10_00-40-00/trial-2367.xml -------------------------------------------------------------------------------------------- trial-2367 FAIL -------------------------------------------------------------------------------------------- 02:04:26.709989 tst trial-2367: trial-2367: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (5.0 sec) Error: osmo-nitb_10.42.42.2(pid=3672): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3672) [trial-2367↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3672)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.2 sec) Error: osmo-stp_10.42.42.5(pid=3682): Process ended prematurely: osmo-stp_10.42.42.5(pid=3682) [trial-2367↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3682)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=3691): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3691) [trial-2367↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3691)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=3701): Process ended prematurely: osmo-stp_10.42.42.5(pid=3701) [trial-2367↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3701)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3715): Process ended prematurely: osmo-stp_10.42.42.5(pid=3715) [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3715)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3726): Process ended prematurely: osmo-stp_10.42.42.5(pid=3726) [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3726)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3740): Process ended prematurely: osmo-stp_10.42.42.5(pid=3740) [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3740)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3751): Process ended prematurely: osmo-stp_10.42.42.5(pid=3751) [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3751)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3765): Process ended prematurely: osmo-stp_10.42.42.5(pid=3765) [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3765)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3776): Process ended prematurely: osmo-stp_10.42.42.5(pid=3776) [trial-2367↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3776)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3791): Process ended prematurely: osmo-stp_10.42.42.5(pid=3791) [trial-2367↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3791)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=3803): Process ended prematurely: osmo-stp_10.42.42.5(pid=3803) [trial-2367↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3803)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3817): Process ended prematurely: osmo-stp_10.42.42.5(pid=3817) [trial-2367↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3817)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3828): Process ended prematurely: osmo-stp_10.42.42.5(pid=3828) [trial-2367↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3828)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3842): Process ended prematurely: osmo-stp_10.42.42.5(pid=3842) [trial-2367↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3842)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3853): Process ended prematurely: osmo-stp_10.42.42.5(pid=3853) [trial-2367↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3853)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3871): Process ended prematurely: osmo-stp_10.42.42.5(pid=3871) [trial-2367↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3871)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=3882): Process ended prematurely: osmo-stp_10.42.42.5(pid=3882) [trial-2367↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3882)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3896): Process ended prematurely: osmo-stp_10.42.42.5(pid=3896) [trial-2367↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3896)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3907): Process ended prematurely: osmo-stp_10.42.42.5(pid=3907) [trial-2367↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3907)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.7 sec) Error: osmo-stp_10.42.42.5(pid=3925): Process ended prematurely: osmo-stp_10.42.42.5(pid=3925) [trial-2367↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3925)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=3937): Process ended prematurely: osmo-stp_10.42.42.5(pid=3937) [trial-2367↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3937)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=3955): Process ended prematurely: osmo-stp_10.42.42.5(pid=3955) [trial-2367↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3955)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3965): Process ended prematurely: osmo-stp_10.42.42.5(pid=3965) [trial-2367↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3965)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=3975): Process ended prematurely: osmo-stp_10.42.42.5(pid=3975) [trial-2367↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3975)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=3993): Process ended prematurely: osmo-stp_10.42.42.5(pid=3993) [trial-2367↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3993)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=4005): Process ended prematurely: osmo-stp_10.42.42.5(pid=4005) [trial-2367↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4005)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=4024): Process ended prematurely: osmo-stp_10.42.42.5(pid=4024) [trial-2367↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4024)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4036): Process ended prematurely: osmo-stp_10.42.42.5(pid=4036) [trial-2367↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4036)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=4046): Process ended prematurely: osmo-stp_10.42.42.5(pid=4046) [trial-2367↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4046)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=4063): Process ended prematurely: osmo-stp_10.42.42.5(pid=4063) [trial-2367↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4063)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=4075): Process ended prematurely: osmo-stp_10.42.42.5(pid=4075) [trial-2367↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4075)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=4093): Process ended prematurely: osmo-stp_10.42.42.5(pid=4093) [trial-2367↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4093)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4103): Process ended prematurely: osmo-stp_10.42.42.5(pid=4103) [trial-2367↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4103)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4113): Process ended prematurely: osmo-stp_10.42.42.5(pid=4113) [trial-2367↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4113)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=4131): Process ended prematurely: osmo-stp_10.42.42.5(pid=4131) [trial-2367↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4131)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=4143): Process ended prematurely: osmo-stp_10.42.42.5(pid=4143) [trial-2367↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4143)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=4162): Process ended prematurely: osmo-stp_10.42.42.5(pid=4162) [trial-2367↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4162)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4172): Process ended prematurely: osmo-stp_10.42.42.5(pid=4172) [trial-2367↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4172)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=4182): Process ended prematurely: osmo-stp_10.42.42.5(pid=4182) [trial-2367↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4182)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4196): Process ended prematurely: osmo-stp_10.42.42.5(pid=4196) [trial-2367↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4196)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4219): Process ended prematurely: osmo-stp_10.42.42.5(pid=4219) [trial-2367↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4219)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=4578): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4578) [trial-2367↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4578)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=4765): Process ended prematurely: osmo-stp_10.42.42.5(pid=4765) [trial-2367↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4765)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=4775): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4775) [trial-2367↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4775)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=4785): Process ended prematurely: osmo-stp_10.42.42.5(pid=4785) [trial-2367↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4785)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4799): Process ended prematurely: osmo-stp_10.42.42.5(pid=4799) [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4799)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4812): Process ended prematurely: osmo-stp_10.42.42.5(pid=4812) [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4812)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4826): Process ended prematurely: osmo-stp_10.42.42.5(pid=4826) [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4826)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4837): Process ended prematurely: osmo-stp_10.42.42.5(pid=4837) [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4837)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=4851): Process ended prematurely: osmo-stp_10.42.42.5(pid=4851) [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4851)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4862): Process ended prematurely: osmo-stp_10.42.42.5(pid=4862) [trial-2367↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4862)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4876): Process ended prematurely: osmo-stp_10.42.42.5(pid=4876) [trial-2367↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4876)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4887): Process ended prematurely: osmo-stp_10.42.42.5(pid=4887) [trial-2367↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4887)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4902): Process ended prematurely: osmo-stp_10.42.42.5(pid=4902) [trial-2367↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4902)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4913): Process ended prematurely: osmo-stp_10.42.42.5(pid=4913) [trial-2367↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4913)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4930): Process ended prematurely: osmo-stp_10.42.42.5(pid=4930) [trial-2367↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4930)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4941): Process ended prematurely: osmo-stp_10.42.42.5(pid=4941) [trial-2367↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4941)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4955): Process ended prematurely: osmo-stp_10.42.42.5(pid=4955) [trial-2367↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4955)] FAIL: mo_mt_call_osmux.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=4979): Process ended prematurely: osmo-stp_10.42.42.5(pid=4979) [trial-2367↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4979)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=5252): Process ended prematurely: osmo-stp_10.42.42.5(pid=5252) [trial-2367↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5252)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5263): Process ended prematurely: osmo-stp_10.42.42.5(pid=5263) [trial-2367↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5263)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=5281): Process ended prematurely: osmo-stp_10.42.42.5(pid=5281) [trial-2367↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5281)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=5294): Process ended prematurely: osmo-stp_10.42.42.5(pid=5294) [trial-2367↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5294)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=5312): Process ended prematurely: osmo-stp_10.42.42.5(pid=5312) [trial-2367↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5312)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5323): Process ended prematurely: osmo-stp_10.42.42.5(pid=5323) [trial-2367↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5323)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5333): Process ended prematurely: osmo-stp_10.42.42.5(pid=5333) [trial-2367↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5333)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=5350): Process ended prematurely: osmo-stp_10.42.42.5(pid=5350) [trial-2367↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5350)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=5365): Process ended prematurely: osmo-stp_10.42.42.5(pid=5365) [trial-2367↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5365)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=5383): Process ended prematurely: osmo-stp_10.42.42.5(pid=5383) [trial-2367↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5383)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5393): Process ended prematurely: osmo-stp_10.42.42.5(pid=5393) [trial-2367↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5393)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5403): Process ended prematurely: osmo-stp_10.42.42.5(pid=5403) [trial-2367↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5403)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=5421): Process ended prematurely: osmo-stp_10.42.42.5(pid=5421) [trial-2367↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5421)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=5446): Process ended prematurely: osmo-stp_10.42.42.5(pid=5446) [trial-2367↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5446)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=5464): Process ended prematurely: osmo-stp_10.42.42.5(pid=5464) [trial-2367↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5464)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5474): Process ended prematurely: osmo-stp_10.42.42.5(pid=5474) [trial-2367↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5474)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5484): Process ended prematurely: osmo-stp_10.42.42.5(pid=5484) [trial-2367↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5484)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=5501): Process ended prematurely: osmo-stp_10.42.42.5(pid=5501) [trial-2367↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5501)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=5513): Process ended prematurely: osmo-stp_10.42.42.5(pid=5513) [trial-2367↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5513)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=5531): Process ended prematurely: osmo-stp_10.42.42.5(pid=5531) [trial-2367↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5531)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5541): Process ended prematurely: osmo-stp_10.42.42.5(pid=5541) [trial-2367↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5541)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5555): Process ended prematurely: osmo-stp_10.42.42.5(pid=5555) [trial-2367↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5555)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5568): Process ended prematurely: osmo-stp_10.42.42.5(pid=5568) [trial-2367↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5568)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5581): Process ended prematurely: osmo-stp_10.42.42.5(pid=5581) [trial-2367↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5581)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=5589): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5589) [trial-2367↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5589)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=5599): Process ended prematurely: osmo-stp_10.42.42.5(pid=5599) [trial-2367↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5599)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=5608): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5608) [trial-2367↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5608)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=5618): Process ended prematurely: osmo-stp_10.42.42.5(pid=5618) [trial-2367↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5618)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5632): Process ended prematurely: osmo-stp_10.42.42.5(pid=5632) [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5632)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=5643): Process ended prematurely: osmo-stp_10.42.42.5(pid=5643) [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5643)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5657): Process ended prematurely: osmo-stp_10.42.42.5(pid=5657) [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5657)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5668): Process ended prematurely: osmo-stp_10.42.42.5(pid=5668) [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5668)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5682): Process ended prematurely: osmo-stp_10.42.42.5(pid=5682) [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5682)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5694): Process ended prematurely: osmo-stp_10.42.42.5(pid=5694) [trial-2367↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5694)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5708): Process ended prematurely: osmo-stp_10.42.42.5(pid=5708) [trial-2367↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5708)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5719): Process ended prematurely: osmo-stp_10.42.42.5(pid=5719) [trial-2367↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5719)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=5738): Process ended prematurely: osmo-stp_10.42.42.5(pid=5738) [trial-2367↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5738)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5749): Process ended prematurely: osmo-stp_10.42.42.5(pid=5749) [trial-2367↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5749)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5763): Process ended prematurely: osmo-stp_10.42.42.5(pid=5763) [trial-2367↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5763)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5774): Process ended prematurely: osmo-stp_10.42.42.5(pid=5774) [trial-2367↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5774)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=5788): Process ended prematurely: osmo-stp_10.42.42.5(pid=5788) [trial-2367↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5788)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5799): Process ended prematurely: osmo-stp_10.42.42.5(pid=5799) [trial-2367↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5799)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=5815): Process ended prematurely: osmo-stp_10.42.42.5(pid=5815) [trial-2367↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5815)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=5826): Process ended prematurely: osmo-stp_10.42.42.5(pid=5826) [trial-2367↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5826)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5841): Process ended prematurely: osmo-stp_10.42.42.5(pid=5841) [trial-2367↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5841)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=5852): Process ended prematurely: osmo-stp_10.42.42.5(pid=5852) [trial-2367↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5852)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5866): Process ended prematurely: osmo-stp_10.42.42.5(pid=5866) [trial-2367↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5866)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5877): Process ended prematurely: osmo-stp_10.42.42.5(pid=5877) [trial-2367↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5877)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=5895): Process ended prematurely: osmo-stp_10.42.42.5(pid=5895) [trial-2367↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5895)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=5908): Process ended prematurely: osmo-stp_10.42.42.5(pid=5908) [trial-2367↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5908)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=5926): Process ended prematurely: osmo-stp_10.42.42.5(pid=5926) [trial-2367↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5926)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5937): Process ended prematurely: osmo-stp_10.42.42.5(pid=5937) [trial-2367↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5937)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5947): Process ended prematurely: osmo-stp_10.42.42.5(pid=5947) [trial-2367↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5947)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=5964): Process ended prematurely: osmo-stp_10.42.42.5(pid=5964) [trial-2367↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5964)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=5976): Process ended prematurely: osmo-stp_10.42.42.5(pid=5976) [trial-2367↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5976)] FAIL: iperf3m4.py (10.2 sec) Error: osmo-stp_10.42.42.5(pid=5994): Process ended prematurely: osmo-stp_10.42.42.5(pid=5994) [trial-2367↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5994)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6004): Process ended prematurely: osmo-stp_10.42.42.5(pid=6004) [trial-2367↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6004)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=6014): Process ended prematurely: osmo-stp_10.42.42.5(pid=6014) [trial-2367↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6014)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=6031): Process ended prematurely: osmo-stp_10.42.42.5(pid=6031) [trial-2367↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6031)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=6043): Process ended prematurely: osmo-stp_10.42.42.5(pid=6043) [trial-2367↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6043)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=6063): Process ended prematurely: osmo-stp_10.42.42.5(pid=6063) [trial-2367↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6063)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6076): Process ended prematurely: osmo-stp_10.42.42.5(pid=6076) [trial-2367↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6076)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6086): Process ended prematurely: osmo-stp_10.42.42.5(pid=6086) [trial-2367↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6086)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=6104): Process ended prematurely: osmo-stp_10.42.42.5(pid=6104) [trial-2367↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6104)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=6116): Process ended prematurely: osmo-stp_10.42.42.5(pid=6116) [trial-2367↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6116)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=6134): Process ended prematurely: osmo-stp_10.42.42.5(pid=6134) [trial-2367↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6134)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6144): Process ended prematurely: osmo-stp_10.42.42.5(pid=6144) [trial-2367↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6144)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6154): Process ended prematurely: osmo-stp_10.42.42.5(pid=6154) [trial-2367↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6154)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=6171): Process ended prematurely: osmo-stp_10.42.42.5(pid=6171) [trial-2367↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6171)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=6183): Process ended prematurely: osmo-stp_10.42.42.5(pid=6183) [trial-2367↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6183)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=6201): Process ended prematurely: osmo-stp_10.42.42.5(pid=6201) [trial-2367↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6201)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6212): Process ended prematurely: osmo-stp_10.42.42.5(pid=6212) [trial-2367↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6212)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6222): Process ended prematurely: osmo-stp_10.42.42.5(pid=6222) [trial-2367↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6222)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6236): Process ended prematurely: osmo-stp_10.42.42.5(pid=6236) [trial-2367↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6236)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6249): Process ended prematurely: osmo-stp_10.42.42.5(pid=6249) [trial-2367↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6249)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=6258): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6258) [trial-2367↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6258)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=6268): Process ended prematurely: osmo-stp_10.42.42.5(pid=6268) [trial-2367↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6268)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=6287): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6287) [trial-2367↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6287)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=6300): Process ended prematurely: osmo-stp_10.42.42.5(pid=6300) [trial-2367↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6300)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=6573): Process ended prematurely: osmo-stp_10.42.42.5(pid=6573) [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6573)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6585): Process ended prematurely: osmo-stp_10.42.42.5(pid=6585) [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6585)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=6599): Process ended prematurely: osmo-stp_10.42.42.5(pid=6599) [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6599)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6610): Process ended prematurely: osmo-stp_10.42.42.5(pid=6610) [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6610)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6624): Process ended prematurely: osmo-stp_10.42.42.5(pid=6624) [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6624)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6635): Process ended prematurely: osmo-stp_10.42.42.5(pid=6635) [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6635)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6651): Process ended prematurely: osmo-stp_10.42.42.5(pid=6651) [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6651)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6662): Process ended prematurely: osmo-stp_10.42.42.5(pid=6662) [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6662)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6676): Process ended prematurely: osmo-stp_10.42.42.5(pid=6676) [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6676)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6687): Process ended prematurely: osmo-stp_10.42.42.5(pid=6687) [trial-2367↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6687)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6712): Process ended prematurely: osmo-stp_10.42.42.5(pid=6712) [trial-2367↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6712)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6900): Process ended prematurely: osmo-stp_10.42.42.5(pid=6900) [trial-2367↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6900)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=7264): Process ended prematurely: osmo-stp_10.42.42.5(pid=7264) [trial-2367↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7264)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7275): Process ended prematurely: osmo-stp_10.42.42.5(pid=7275) [trial-2367↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7275)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7289): Process ended prematurely: osmo-stp_10.42.42.5(pid=7289) [trial-2367↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7289)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=7300): Process ended prematurely: osmo-stp_10.42.42.5(pid=7300) [trial-2367↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7300)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=7318): Process ended prematurely: osmo-stp_10.42.42.5(pid=7318) [trial-2367↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7318)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=7330): Process ended prematurely: osmo-stp_10.42.42.5(pid=7330) [trial-2367↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7330)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=7348): Process ended prematurely: osmo-stp_10.42.42.5(pid=7348) [trial-2367↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7348)] FAIL: ping.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=7358): Process ended prematurely: osmo-stp_10.42.42.5(pid=7358) [trial-2367↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7358)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7368): Process ended prematurely: osmo-stp_10.42.42.5(pid=7368) [trial-2367↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7368)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=7387): Process ended prematurely: osmo-stp_10.42.42.5(pid=7387) [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7387)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=7399): Process ended prematurely: osmo-stp_10.42.42.5(pid=7399) [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7399)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=7422): Process ended prematurely: osmo-stp_10.42.42.5(pid=7422) [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7422)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=7432): Process ended prematurely: osmo-stp_10.42.42.5(pid=7432) [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7432)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7442): Process ended prematurely: osmo-stp_10.42.42.5(pid=7442) [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7442)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=7459): Process ended prematurely: osmo-stp_10.42.42.5(pid=7459) [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7459)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=7472): Process ended prematurely: osmo-stp_10.42.42.5(pid=7472) [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7472)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=7490): Process ended prematurely: osmo-stp_10.42.42.5(pid=7490) [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7490)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=7500): Process ended prematurely: osmo-stp_10.42.42.5(pid=7500) [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7500)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=7510): Process ended prematurely: osmo-stp_10.42.42.5(pid=7510) [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7510)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=7527): Process ended prematurely: osmo-stp_10.42.42.5(pid=7527) [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7527)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=7539): Process ended prematurely: osmo-stp_10.42.42.5(pid=7539) [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7539)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=7557): Process ended prematurely: osmo-stp_10.42.42.5(pid=7557) [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7557)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7570): Process ended prematurely: osmo-stp_10.42.42.5(pid=7570) [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7570)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7580): Process ended prematurely: osmo-stp_10.42.42.5(pid=7580) [trial-2367↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7580)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7596): Process ended prematurely: osmo-stp_10.42.42.5(pid=7596) [trial-2367↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7596)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=7609): Process ended prematurely: osmo-stp_10.42.42.5(pid=7609) [trial-2367↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7609)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=7618): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7618) [trial-2367↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7618)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7628): Process ended prematurely: osmo-stp_10.42.42.5(pid=7628) [trial-2367↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7628)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=7637): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7637) [trial-2367↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7637)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=7647): Process ended prematurely: osmo-stp_10.42.42.5(pid=7647) [trial-2367↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7647)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7661): Process ended prematurely: osmo-stp_10.42.42.5(pid=7661) [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7661)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7672): Process ended prematurely: osmo-stp_10.42.42.5(pid=7672) [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7672)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7686): Process ended prematurely: osmo-stp_10.42.42.5(pid=7686) [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7686)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7697): Process ended prematurely: osmo-stp_10.42.42.5(pid=7697) [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7697)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7711): Process ended prematurely: osmo-stp_10.42.42.5(pid=7711) [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7711)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7725): Process ended prematurely: osmo-stp_10.42.42.5(pid=7725) [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7725)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7739): Process ended prematurely: osmo-stp_10.42.42.5(pid=7739) [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7739)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7750): Process ended prematurely: osmo-stp_10.42.42.5(pid=7750) [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7750)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7765): Process ended prematurely: osmo-stp_10.42.42.5(pid=7765) [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7765)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7776): Process ended prematurely: osmo-stp_10.42.42.5(pid=7776) [trial-2367↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7776)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7790): Process ended prematurely: osmo-stp_10.42.42.5(pid=7790) [trial-2367↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7790)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=7801): Process ended prematurely: osmo-stp_10.42.42.5(pid=7801) [trial-2367↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7801)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7815): Process ended prematurely: osmo-stp_10.42.42.5(pid=7815) [trial-2367↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7815)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=7826): Process ended prematurely: osmo-stp_10.42.42.5(pid=7826) [trial-2367↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7826)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7840): Process ended prematurely: osmo-stp_10.42.42.5(pid=7840) [trial-2367↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7840)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=7851): Process ended prematurely: osmo-stp_10.42.42.5(pid=7851) [trial-2367↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7851)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=7865): Process ended prematurely: osmo-stp_10.42.42.5(pid=7865) [trial-2367↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7865)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7876): Process ended prematurely: osmo-stp_10.42.42.5(pid=7876) [trial-2367↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7876)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=7894): Process ended prematurely: osmo-stp_10.42.42.5(pid=7894) [trial-2367↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7894)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=7906): Process ended prematurely: osmo-stp_10.42.42.5(pid=7906) [trial-2367↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7906)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=7924): Process ended prematurely: osmo-stp_10.42.42.5(pid=7924) [trial-2367↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7924)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7937): Process ended prematurely: osmo-stp_10.42.42.5(pid=7937) [trial-2367↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7937)] FAIL: ping_idle_ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7947): Process ended prematurely: osmo-stp_10.42.42.5(pid=7947) [trial-2367↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7947)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=7966): Process ended prematurely: osmo-stp_10.42.42.5(pid=7966) [trial-2367↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7966)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=7978): Process ended prematurely: osmo-stp_10.42.42.5(pid=7978) [trial-2367↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7978)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=7996): Process ended prematurely: osmo-stp_10.42.42.5(pid=7996) [trial-2367↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7996)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8006): Process ended prematurely: osmo-stp_10.42.42.5(pid=8006) [trial-2367↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8006)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8016): Process ended prematurely: osmo-stp_10.42.42.5(pid=8016) [trial-2367↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8016)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=8035): Process ended prematurely: osmo-stp_10.42.42.5(pid=8035) [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8035)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=8050): Process ended prematurely: osmo-stp_10.42.42.5(pid=8050) [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8050)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=8068): Process ended prematurely: osmo-stp_10.42.42.5(pid=8068) [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8068)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8078): Process ended prematurely: osmo-stp_10.42.42.5(pid=8078) [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8078)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8088): Process ended prematurely: osmo-stp_10.42.42.5(pid=8088) [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8088)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=8105): Process ended prematurely: osmo-stp_10.42.42.5(pid=8105) [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8105)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=8117): Process ended prematurely: osmo-stp_10.42.42.5(pid=8117) [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8117)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=8135): Process ended prematurely: osmo-stp_10.42.42.5(pid=8135) [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8135)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8145): Process ended prematurely: osmo-stp_10.42.42.5(pid=8145) [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8145)] FAIL: ping_idle_ping.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=8427): Process ended prematurely: osmo-stp_10.42.42.5(pid=8427) [trial-2367↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8427)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (9.7 sec) Error: osmo-stp_10.42.42.5(pid=8444): Process ended prematurely: osmo-stp_10.42.42.5(pid=8444) [trial-2367↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8444)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=8457): Process ended prematurely: osmo-stp_10.42.42.5(pid=8457) [trial-2367↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8457)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=8475): Process ended prematurely: osmo-stp_10.42.42.5(pid=8475) [trial-2367↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8475)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8485): Process ended prematurely: osmo-stp_10.42.42.5(pid=8485) [trial-2367↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8485)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8495): Process ended prematurely: osmo-stp_10.42.42.5(pid=8495) [trial-2367↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8495)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8509): Process ended prematurely: osmo-stp_10.42.42.5(pid=8509) [trial-2367↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8509)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8524): Process ended prematurely: osmo-stp_10.42.42.5(pid=8524) [trial-2367↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8524)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=8533): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8533) [trial-2367↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8533)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8546): Process ended prematurely: osmo-stp_10.42.42.5(pid=8546) [trial-2367↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8546)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=8555): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8555) [trial-2367↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8555)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=8565): Process ended prematurely: osmo-stp_10.42.42.5(pid=8565) [trial-2367↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8565)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8579): Process ended prematurely: osmo-stp_10.42.42.5(pid=8579) [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8579)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8591): Process ended prematurely: osmo-stp_10.42.42.5(pid=8591) [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8591)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=8605): Process ended prematurely: osmo-stp_10.42.42.5(pid=8605) [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8605)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8616): Process ended prematurely: osmo-stp_10.42.42.5(pid=8616) [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8616)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8630): Process ended prematurely: osmo-stp_10.42.42.5(pid=8630) [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8630)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=8641): Process ended prematurely: osmo-stp_10.42.42.5(pid=8641) [trial-2367↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8641)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8655): Process ended prematurely: osmo-stp_10.42.42.5(pid=8655) [trial-2367↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8655)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8666): Process ended prematurely: osmo-stp_10.42.42.5(pid=8666) [trial-2367↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8666)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8680): Process ended prematurely: osmo-stp_10.42.42.5(pid=8680) [trial-2367↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8680)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8691): Process ended prematurely: osmo-stp_10.42.42.5(pid=8691) [trial-2367↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8691)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8705): Process ended prematurely: osmo-stp_10.42.42.5(pid=8705) [trial-2367↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8705)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8716): Process ended prematurely: osmo-stp_10.42.42.5(pid=8716) [trial-2367↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8716)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8733): Process ended prematurely: osmo-stp_10.42.42.5(pid=8733) [trial-2367↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8733)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8744): Process ended prematurely: osmo-stp_10.42.42.5(pid=8744) [trial-2367↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8744)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8758): Process ended prematurely: osmo-stp_10.42.42.5(pid=8758) [trial-2367↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8758)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8769): Process ended prematurely: osmo-stp_10.42.42.5(pid=8769) [trial-2367↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8769)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=8787): Process ended prematurely: osmo-stp_10.42.42.5(pid=8787) [trial-2367↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8787)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=8799): Process ended prematurely: osmo-stp_10.42.42.5(pid=8799) [trial-2367↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8799)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=8817): Process ended prematurely: osmo-stp_10.42.42.5(pid=8817) [trial-2367↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8817)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8827): Process ended prematurely: osmo-stp_10.42.42.5(pid=8827) [trial-2367↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8827)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8837): Process ended prematurely: osmo-stp_10.42.42.5(pid=8837) [trial-2367↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8837)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=8854): Process ended prematurely: osmo-stp_10.42.42.5(pid=8854) [trial-2367↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8854)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=8866): Process ended prematurely: osmo-stp_10.42.42.5(pid=8866) [trial-2367↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8866)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=8884): Process ended prematurely: osmo-stp_10.42.42.5(pid=8884) [trial-2367↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8884)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8897): Process ended prematurely: osmo-stp_10.42.42.5(pid=8897) [trial-2367↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8897)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=8907): Process ended prematurely: osmo-stp_10.42.42.5(pid=8907) [trial-2367↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8907)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=8924): Process ended prematurely: osmo-stp_10.42.42.5(pid=8924) [trial-2367↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8924)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=8936): Process ended prematurely: osmo-stp_10.42.42.5(pid=8936) [trial-2367↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8936)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=8955): Process ended prematurely: osmo-stp_10.42.42.5(pid=8955) [trial-2367↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8955)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8965): Process ended prematurely: osmo-stp_10.42.42.5(pid=8965) [trial-2367↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8965)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8975): Process ended prematurely: osmo-stp_10.42.42.5(pid=8975) [trial-2367↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8975)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=8994): Process ended prematurely: osmo-stp_10.42.42.5(pid=8994) [trial-2367↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8994)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=9007): Process ended prematurely: osmo-stp_10.42.42.5(pid=9007) [trial-2367↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9007)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=9025): Process ended prematurely: osmo-stp_10.42.42.5(pid=9025) [trial-2367↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9025)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9035): Process ended prematurely: osmo-stp_10.42.42.5(pid=9035) [trial-2367↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9035)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9045): Process ended prematurely: osmo-stp_10.42.42.5(pid=9045) [trial-2367↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9045)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9059): Process ended prematurely: osmo-stp_10.42.42.5(pid=9059) [trial-2367↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9059)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9076): Process ended prematurely: osmo-stp_10.42.42.5(pid=9076) [trial-2367↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9076)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=9084): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9084) [trial-2367↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9084)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9094): Process ended prematurely: osmo-stp_10.42.42.5(pid=9094) [trial-2367↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9094)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=9104): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9104) [trial-2367↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9104)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=9114): Process ended prematurely: osmo-stp_10.42.42.5(pid=9114) [trial-2367↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9114)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9128): Process ended prematurely: osmo-stp_10.42.42.5(pid=9128) [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9128)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9139): Process ended prematurely: osmo-stp_10.42.42.5(pid=9139) [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9139)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9153): Process ended prematurely: osmo-stp_10.42.42.5(pid=9153) [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9153)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9164): Process ended prematurely: osmo-stp_10.42.42.5(pid=9164) [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9164)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=9178): Process ended prematurely: osmo-stp_10.42.42.5(pid=9178) [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9178)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=9189): Process ended prematurely: osmo-stp_10.42.42.5(pid=9189) [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9189)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9203): Process ended prematurely: osmo-stp_10.42.42.5(pid=9203) [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9203)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9214): Process ended prematurely: osmo-stp_10.42.42.5(pid=9214) [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9214)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9228): Process ended prematurely: osmo-stp_10.42.42.5(pid=9228) [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9228)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9239): Process ended prematurely: osmo-stp_10.42.42.5(pid=9239) [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9239)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=9256): Process ended prematurely: osmo-stp_10.42.42.5(pid=9256) [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9256)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9267): Process ended prematurely: osmo-stp_10.42.42.5(pid=9267) [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9267)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=9281): Process ended prematurely: osmo-stp_10.42.42.5(pid=9281) [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9281)] FAIL: mo_mt_call_osmux.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=9292): Process ended prematurely: osmo-stp_10.42.42.5(pid=9292) [trial-2367↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9292)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=9307): Process ended prematurely: osmo-stp_10.42.42.5(pid=9307) [trial-2367↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9307)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9318): Process ended prematurely: osmo-stp_10.42.42.5(pid=9318) [trial-2367↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9318)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=9337): Process ended prematurely: osmo-stp_10.42.42.5(pid=9337) [trial-2367↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9337)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=9349): Process ended prematurely: osmo-stp_10.42.42.5(pid=9349) [trial-2367↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9349)] FAIL: iperf3m4.py (10.2 sec) Error: osmo-stp_10.42.42.5(pid=9367): Process ended prematurely: osmo-stp_10.42.42.5(pid=9367) [trial-2367↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9367)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9378): Process ended prematurely: osmo-stp_10.42.42.5(pid=9378) [trial-2367↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9378)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9388): Process ended prematurely: osmo-stp_10.42.42.5(pid=9388) [trial-2367↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9388)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=9405): Process ended prematurely: osmo-stp_10.42.42.5(pid=9405) [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9405)] FAIL: iperf3.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=9417): Process ended prematurely: osmo-stp_10.42.42.5(pid=9417) [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9417)] FAIL: iperf3m4.py (10.1 sec) Error: osmo-stp_10.42.42.5(pid=9441): Process ended prematurely: osmo-stp_10.42.42.5(pid=9441) [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9441)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9451): Process ended prematurely: osmo-stp_10.42.42.5(pid=9451) [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9451)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9461): Process ended prematurely: osmo-stp_10.42.42.5(pid=9461) [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9461)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=9478): Process ended prematurely: osmo-stp_10.42.42.5(pid=9478) [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9478)] FAIL: iperf3.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=9762): Process ended prematurely: osmo-stp_10.42.42.5(pid=9762) [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9762)] FAIL: iperf3m4.py (11.5 sec) Error: osmo-stp_10.42.42.5(pid=9780): Process ended prematurely: osmo-stp_10.42.42.5(pid=9780) [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9780)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9790): Process ended prematurely: osmo-stp_10.42.42.5(pid=9790) [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9790)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9800): Process ended prematurely: osmo-stp_10.42.42.5(pid=9800) [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9800)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=9818): Process ended prematurely: osmo-stp_10.42.42.5(pid=9818) [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9818)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=9830): Process ended prematurely: osmo-stp_10.42.42.5(pid=9830) [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9830)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=9849): Process ended prematurely: osmo-stp_10.42.42.5(pid=9849) [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9849)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9859): Process ended prematurely: osmo-stp_10.42.42.5(pid=9859) [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9859)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9872): Process ended prematurely: osmo-stp_10.42.42.5(pid=9872) [trial-2367↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9872)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9885): Process ended prematurely: osmo-stp_10.42.42.5(pid=9885) [trial-2367↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9885)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9899): Process ended prematurely: osmo-stp_10.42.42.5(pid=9899) [trial-2367↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9899)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=9907): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9907) [trial-2367↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9907)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9919): Process ended prematurely: osmo-stp_10.42.42.5(pid=9919) [trial-2367↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9919)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=9928): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9928) [trial-2367↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9928)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9938): Process ended prematurely: osmo-stp_10.42.42.5(pid=9938) [trial-2367↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9938)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9952): Process ended prematurely: osmo-stp_10.42.42.5(pid=9952) [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9952)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9964): Process ended prematurely: osmo-stp_10.42.42.5(pid=9964) [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9964)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9978): Process ended prematurely: osmo-stp_10.42.42.5(pid=9978) [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9978)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9989): Process ended prematurely: osmo-stp_10.42.42.5(pid=9989) [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9989)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10003): Process ended prematurely: osmo-stp_10.42.42.5(pid=10003) [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10003)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10023): Process ended prematurely: osmo-stp_10.42.42.5(pid=10023) [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10023)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10037): Process ended prematurely: osmo-stp_10.42.42.5(pid=10037) [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10037)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10048): Process ended prematurely: osmo-stp_10.42.42.5(pid=10048) [trial-2367↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10048)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10062): Process ended prematurely: osmo-stp_10.42.42.5(pid=10062) [trial-2367↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10062)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10073): Process ended prematurely: osmo-stp_10.42.42.5(pid=10073) [trial-2367↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10073)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10087): Process ended prematurely: osmo-stp_10.42.42.5(pid=10087) [trial-2367↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10087)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10098): Process ended prematurely: osmo-stp_10.42.42.5(pid=10098) [trial-2367↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10098)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=10116): Process ended prematurely: osmo-stp_10.42.42.5(pid=10116) [trial-2367↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10116)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=10128): Process ended prematurely: osmo-stp_10.42.42.5(pid=10128) [trial-2367↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10128)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=10146): Process ended prematurely: osmo-stp_10.42.42.5(pid=10146) [trial-2367↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10146)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10156): Process ended prematurely: osmo-stp_10.42.42.5(pid=10156) [trial-2367↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10156)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10166): Process ended prematurely: osmo-stp_10.42.42.5(pid=10166) [trial-2367↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10166)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=10184): Process ended prematurely: osmo-stp_10.42.42.5(pid=10184) [trial-2367↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10184)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=10196): Process ended prematurely: osmo-stp_10.42.42.5(pid=10196) [trial-2367↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10196)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=10214): Process ended prematurely: osmo-stp_10.42.42.5(pid=10214) [trial-2367↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10214)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10227): Process ended prematurely: osmo-stp_10.42.42.5(pid=10227) [trial-2367↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10227)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10237): Process ended prematurely: osmo-stp_10.42.42.5(pid=10237) [trial-2367↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10237)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=10255): Process ended prematurely: osmo-stp_10.42.42.5(pid=10255) [trial-2367↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10255)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=10267): Process ended prematurely: osmo-stp_10.42.42.5(pid=10267) [trial-2367↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10267)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=10285): Process ended prematurely: osmo-stp_10.42.42.5(pid=10285) [trial-2367↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10285)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10295): Process ended prematurely: osmo-stp_10.42.42.5(pid=10295) [trial-2367↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10295)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10305): Process ended prematurely: osmo-stp_10.42.42.5(pid=10305) [trial-2367↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10305)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10319): Process ended prematurely: osmo-stp_10.42.42.5(pid=10319) [trial-2367↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10319)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10332): Process ended prematurely: osmo-stp_10.42.42.5(pid=10332) [trial-2367↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10332)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=10341): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10341) [trial-2367↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10341)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10351): Process ended prematurely: osmo-stp_10.42.42.5(pid=10351) [trial-2367↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10351)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10365): Process ended prematurely: osmo-stp_10.42.42.5(pid=10365) [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10365)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10376): Process ended prematurely: osmo-stp_10.42.42.5(pid=10376) [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10376)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10396): Process ended prematurely: osmo-stp_10.42.42.5(pid=10396) [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10396)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10407): Process ended prematurely: osmo-stp_10.42.42.5(pid=10407) [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10407)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10421): Process ended prematurely: osmo-stp_10.42.42.5(pid=10421) [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10421)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10432): Process ended prematurely: osmo-stp_10.42.42.5(pid=10432) [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10432)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10446): Process ended prematurely: osmo-stp_10.42.42.5(pid=10446) [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10446)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10457): Process ended prematurely: osmo-stp_10.42.42.5(pid=10457) [trial-2367↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10457)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10471): Process ended prematurely: osmo-stp_10.42.42.5(pid=10471) [trial-2367↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10471)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10482): Process ended prematurely: osmo-stp_10.42.42.5(pid=10482) [trial-2367↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10482)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10496): Process ended prematurely: osmo-stp_10.42.42.5(pid=10496) [trial-2367↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10496)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10507): Process ended prematurely: osmo-stp_10.42.42.5(pid=10507) [trial-2367↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10507)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10521): Process ended prematurely: osmo-stp_10.42.42.5(pid=10521) [trial-2367↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10521)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10532): Process ended prematurely: osmo-stp_10.42.42.5(pid=10532) [trial-2367↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10532)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=10550): Process ended prematurely: osmo-stp_10.42.42.5(pid=10550) [trial-2367↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10550)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=10562): Process ended prematurely: osmo-stp_10.42.42.5(pid=10562) [trial-2367↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10562)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=10580): Process ended prematurely: osmo-stp_10.42.42.5(pid=10580) [trial-2367↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10580)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=10593): Process ended prematurely: osmo-stp_10.42.42.5(pid=10593) [trial-2367↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10593)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10603): Process ended prematurely: osmo-stp_10.42.42.5(pid=10603) [trial-2367↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10603)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=10621): Process ended prematurely: osmo-stp_10.42.42.5(pid=10621) [trial-2367↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10621)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=10633): Process ended prematurely: osmo-stp_10.42.42.5(pid=10633) [trial-2367↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10633)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=10651): Process ended prematurely: osmo-stp_10.42.42.5(pid=10651) [trial-2367↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10651)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=10661): Process ended prematurely: osmo-stp_10.42.42.5(pid=10661) [trial-2367↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10661)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10671): Process ended prematurely: osmo-stp_10.42.42.5(pid=10671) [trial-2367↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10671)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=10690): Process ended prematurely: osmo-stp_10.42.42.5(pid=10690) [trial-2367↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10690)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=10702): Process ended prematurely: osmo-stp_10.42.42.5(pid=10702) [trial-2367↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10702)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=10720): Process ended prematurely: osmo-stp_10.42.42.5(pid=10720) [trial-2367↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10720)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=10730): Process ended prematurely: osmo-stp_10.42.42.5(pid=10730) [trial-2367↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10730)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10740): Process ended prematurely: osmo-stp_10.42.42.5(pid=10740) [trial-2367↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10740)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=10762): Process ended prematurely: osmo-stp_10.42.42.5(pid=10762) [trial-2367↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10762)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=10774): Process ended prematurely: osmo-stp_10.42.42.5(pid=10774) [trial-2367↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10774)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=10792): Process ended prematurely: osmo-stp_10.42.42.5(pid=10792) [trial-2367↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10792)] FAIL: ping.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=10824): Process ended prematurely: osmo-stp_10.42.42.5(pid=10824) [trial-2367↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10824)] FAIL: ping_idle_ping.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=11117): Process ended prematurely: osmo-stp_10.42.42.5(pid=11117) [trial-2367↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11117)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=11130): Process ended prematurely: osmo-stp_10.42.42.5(pid=11130) [trial-2367↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11130)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.5 sec) Error: osmo-nitb_10.42.42.2(pid=11142): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11142) [trial-2367↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11142)] FAIL: esme_connect_policy_closed.py (2.0 sec) Error: osmo-nitb_10.42.42.2(pid=11144): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11144) [trial-2367↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11144)] FAIL: esme_ms_sms_storeforward.py (2.7 sec) Error: osmo-nitb_10.42.42.2(pid=11146): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11146) [trial-2367↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11146)] FAIL: esme_ms_sms_transaction.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=11148): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11148) [trial-2367↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11148)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.8 sec) Error: osmo-hlr_10.42.42.2(pid=11157): Process ended prematurely: osmo-hlr_10.42.42.2(pid=11157) [trial-2367↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11157)] FAIL: esme_connect_policy_closed.py (5.9 sec) Error: osmo-hlr_10.42.42.2(pid=11168): Process ended prematurely: osmo-hlr_10.42.42.2(pid=11168) [trial-2367↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11168)] FAIL: esme_ms_sms_storeforward.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11180): Process ended prematurely: osmo-stp_10.42.42.5(pid=11180) [trial-2367↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11180)] FAIL: esme_ms_sms_transaction.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11191): Process ended prematurely: osmo-stp_10.42.42.5(pid=11191) [trial-2367↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11191)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11205): Process ended prematurely: osmo-stp_10.42.42.5(pid=11205) [trial-2367↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11205)] FAIL: register_a5_0_authreq.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11216): Process ended prematurely: osmo-stp_10.42.42.5(pid=11216) [trial-2367↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11216)] FAIL: register_a5_1_authreq.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11227): Process ended prematurely: osmo-stp_10.42.42.5(pid=11227) [trial-2367↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11227)] FAIL: register_a5_3_authreq.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11238): Process ended prematurely: osmo-stp_10.42.42.5(pid=11238) [trial-2367↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11238)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (20.3 sec) Error: srsepc(pid=11261): Process ended prematurely: srsepc(pid=11261) [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11261)] FAIL: iperf3_bidir.py (19.1 sec) Error: srsepc(pid=11277): Process ended prematurely: srsepc(pid=11277) [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11277)] FAIL: iperf3_dl.py (18.8 sec) Error: srsepc(pid=11293): Process ended prematurely: srsepc(pid=11293) [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11293)] FAIL: iperf3_ul.py (18.8 sec) Error: srsepc(pid=11309): Process ended prematurely: srsepc(pid=11309) [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11309)] FAIL: ping.py (18.4 sec) Error: srsepc(pid=11325): Process ended prematurely: srsepc(pid=11325) [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11325)] FAIL: rrc_idle_mo_ping.py (18.3 sec) Error: srsepc(pid=11342): Process ended prematurely: srsepc(pid=11342) [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11342)] FAIL: rrc_idle_mt_ping.py (18.3 sec) Error: srsepc(pid=11358): Process ended prematurely: srsepc(pid=11358) [trial-2367↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11358)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=11374): Process ended prematurely: osmo-stp_10.42.42.5(pid=11374) [trial-2367↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11374)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11389): Process ended prematurely: osmo-stp_10.42.42.5(pid=11389) [trial-2367↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11389)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11403): Process ended prematurely: osmo-stp_10.42.42.5(pid=11403) [trial-2367↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11403)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11417): Process ended prematurely: osmo-stp_10.42.42.5(pid=11417) [trial-2367↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11417)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=11431): Process ended prematurely: osmo-stp_10.42.42.5(pid=11431) [trial-2367↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11431)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11445): Process ended prematurely: osmo-stp_10.42.42.5(pid=11445) [trial-2367↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11445)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11459): Process ended prematurely: osmo-stp_10.42.42.5(pid=11459) [trial-2367↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11459)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11473): Process ended prematurely: osmo-stp_10.42.42.5(pid=11473) [trial-2367↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11473)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=11488): Process ended prematurely: osmo-stp_10.42.42.5(pid=11488) [trial-2367↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11488)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=11502): Process ended prematurely: osmo-stp_10.42.42.5(pid=11502) [trial-2367↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11502)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11516): Process ended prematurely: osmo-stp_10.42.42.5(pid=11516) [trial-2367↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11516)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11531): Process ended prematurely: osmo-stp_10.42.42.5(pid=11531) [trial-2367↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11531)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=11545): Process ended prematurely: osmo-stp_10.42.42.5(pid=11545) [trial-2367↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11545)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=11563): Process ended prematurely: osmo-stp_10.42.42.5(pid=11563) [trial-2367↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11563)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11578): Process ended prematurely: osmo-stp_10.42.42.5(pid=11578) [trial-2367↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11578)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11592): Process ended prematurely: osmo-stp_10.42.42.5(pid=11592) [trial-2367↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11592)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11606): Process ended prematurely: osmo-stp_10.42.42.5(pid=11606) [trial-2367↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11606)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=11620): Process ended prematurely: osmo-stp_10.42.42.5(pid=11620) [trial-2367↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11620)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=11634): Process ended prematurely: osmo-stp_10.42.42.5(pid=11634) [trial-2367↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11634)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11648): Process ended prematurely: osmo-stp_10.42.42.5(pid=11648) [trial-2367↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11648)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=11662): Process ended prematurely: osmo-stp_10.42.42.5(pid=11662) [trial-2367↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11662)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11676): Process ended prematurely: osmo-stp_10.42.42.5(pid=11676) [trial-2367↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11676)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=11690): Process ended prematurely: osmo-stp_10.42.42.5(pid=11690) [trial-2367↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11690)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11704): Process ended prematurely: osmo-stp_10.42.42.5(pid=11704) [trial-2367↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11704)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11719): Process ended prematurely: osmo-stp_10.42.42.5(pid=11719) [trial-2367↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11719)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11734): Process ended prematurely: osmo-stp_10.42.42.5(pid=11734) [trial-2367↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11734)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11748): Process ended prematurely: osmo-stp_10.42.42.5(pid=11748) [trial-2367↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11748)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=11762): Process ended prematurely: osmo-stp_10.42.42.5(pid=11762) [trial-2367↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11762)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11777): Process ended prematurely: osmo-stp_10.42.42.5(pid=11777) [trial-2367↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11777)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11792): Process ended prematurely: osmo-stp_10.42.42.5(pid=11792) [trial-2367↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11792)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11806): Process ended prematurely: osmo-stp_10.42.42.5(pid=11806) [trial-2367↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11806)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11820): Process ended prematurely: osmo-stp_10.42.42.5(pid=11820) [trial-2367↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11820)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=11834): Process ended prematurely: osmo-stp_10.42.42.5(pid=11834) [trial-2367↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11834)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11848): Process ended prematurely: osmo-stp_10.42.42.5(pid=11848) [trial-2367↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11848)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11862): Process ended prematurely: osmo-stp_10.42.42.5(pid=11862) [trial-2367↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11862)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11876): Process ended prematurely: osmo-stp_10.42.42.5(pid=11876) [trial-2367↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11876)] + rm -rf trial-2367/inst + cd trial-2367 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-10 00:39:49 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367-run.tgz run.2022-12-10_00-40-00 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2367-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17654.tgz osmo-bts-oc2g.build-5532.tgz osmo-bts-sysmo.build-8036.tgz osmo-bts.build-7505.tgz osmo-ggsn.build-6679.tgz osmo-hlr.build-8699.tgz osmo-hnbgw.build-2949.tgz osmo-mgw.build-8944.tgz osmo-msc.build-29263.tgz osmo-nitb.build-12967.tgz osmo-pcu-oc2g.build-3907.tgz osmo-pcu-sysmo.build-5189.tgz osmo-pcu.build-5150.tgz osmo-sgsn.build-30040.tgz osmo-stp.build-9239.tgz osmo-trx.build-4675.tgz osmocom-bb.build-4700.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE